00000001:02000400:3.0F:1785393525.699623:0:2967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:3.0:1785393549.728880:0:3191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1785393551.963850:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 342 MB/s 00000001:01000000:0.0F:1785393552.213603:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 467 MB/s 00000001:01000000:1.0F:1785393552.463860:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2943 MB/s 00000020:02000000:3.0:1785393553.446401:0:3284:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_2_geb69296 00000400:02000000:2.0F:1785393555.010698:0:3299:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:2.0:1785393559.755740:0:3449:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1785393628.002327:0:5283:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1785393643.376993:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785393643.376999:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785393643.377213:0:5812:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000193741fd 00000080:02000400:3.0:1785393643.377224:0:5812:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1785393643.395281:0:5812:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1785393643.395292:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785393643.395325:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fba44532) 00000020:00000080:3.0:1785393643.395343:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785393643.468802:0:5812:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1785393643.473864:0:5812:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1785393643.572737:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1785393643.572776:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1785393643.572795:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1785393643.572847:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1785393643.578192:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1785393643.578540:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1785393643.578547:0:5812:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1785393643.578557:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b36296a1 00000020:01000004:0.0:1785393643.578564:0:5812:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1785393643.578584:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1785393643.578589:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000193741fd from MGS 00000020:01000004:0.0:1785393643.578593:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1785393643.578610:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ab183620) 00000020:00000080:0.0:1785393643.578621:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1785393643.578711:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000193741fd from MGS, refs=2 00080000:01000000:0.0:1785393643.578725:0:5812:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785393643.578729:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b36296af 00000100:00100000:0.0:1785393643.578802:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1785393643.578918:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1785393643.578924:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1785393643.588527:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1785393643.588542:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1785393643.590276:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393643.590443:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1785393643.590456:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1785393643.612456:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1785393643.612478:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1785393643.614447:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1785393643.614455:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1785393643.617373:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393643.617377:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393643.617379:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393643.617980:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393643.617983:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393643.617984:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393643.618525:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1785393643.640100:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1785393643.867672:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1099 MB/s 00000001:01000000:1.0:1785393644.117997:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1095 MB/s 00000001:01000000:3.0:1785393644.377409:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 208 MB/s 00000001:01000000:3.0:1785393644.626715:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 203 MB/s 00010000:00010000:0.0:1785393644.648303:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1785393644.654949:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1785393644.727084:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1785393644.727098:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785393644.727101:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1785393644.734759:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1785393644.735364:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1785393644.735420:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1785393644.736022:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1785393644.736047:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1785393644.737450:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.737659:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1785393644.737665:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1785393644.738159:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1785393644.738165:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1785393644.738378:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1785393644.738383:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1785393644.738893:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1785393644.738909:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:3.0:1785393644.738911:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1785393644.738948:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:3.0:1785393644.738961:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (0000000047899299) 00000020:00000080:3.0:1785393644.738974:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1785393644.739063:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003c085683@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785393644.739181:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:3.0:1785393644.739187:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:3.0:1785393644.739860:0:5827:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1785393644.739881:0:5828:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1785393644.745928:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5) 00000020:00000080:2.0:1785393644.745952:0:5812:0:(genops.c:1406:class_connect()) connect: client 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5, cookie 0xcc9b96d8b36296bd 00000100:00080000:2.0:1785393644.745962:0:5812:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785393644.745966:0:5812:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import 000000003c085683 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1785393644.746004:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a93f516 x1872120831279232/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785393644.746041:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS 00000020:01000004:2.0:1785393644.746062:0:5812:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1785393644.746067:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1785393644.746083:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000035732647) 00000020:00000080:2.0:1785393644.746095:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1785393644.746289:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008a93f516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831279232:0@lo:250: 00000100:00100000:3.0:1785393644.746366:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393644.746421:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279232 00000100:00100000:3.0:1785393644.746427:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279232 00000100:00100000:3.0:1785393644.746450:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785393644.746456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f676454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1872120831279232:12345-0@lo:250: 00010000:00080000:3.0:1785393644.746474:0:5824:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1785393644.746500:0:5824:0:(genops.c:1406:class_connect()) connect: client 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5, cookie 0xcc9b96d8b36296cb 00000100:00080000:3.0:1785393644.746622:0:5824:0:(import.c:65:import_set_state_nolock()) 00000000ec236d26 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785393644.746663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f676454 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:3314:x1872120831279232:12345-0@lo:250: Request processed in 207us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393644.746682:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785393644.746723:0:3314:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1785393644.746730:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1785393644.746736:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1785393644.746739:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1785393644.746741:0:3314:0:(import.c:65:import_set_state_nolock()) 000000003c085683 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1785393644.746744:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1785393644.746750:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1785393644.746754:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008a93f516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831279232:0@lo:250: 00000100:00100000:3.0:1785393644.772939:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.773131:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1785393644.773142:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1785393644.774664:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1785393644.774730:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1785393644.775497:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1785393644.775503:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1785393644.776340:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785393644.776488:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1785393644.776493:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1785393644.777112:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1785393644.777128:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1785393644.926721:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785393644.927056:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1785393644.927062:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1785393644.928400:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1785393644.928407:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1785393644.929073:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.929205:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785393644.929210:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1785393644.931806:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785393644.931826:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1785393644.932999:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.933161:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785393644.933166:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1785393644.935475:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785393644.935486:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1785393644.937091:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.937241:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785393644.937245:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1785393644.941906:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1785393644.941919:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1785393644.972520:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393644.973247:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1785393644.973254:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1785393644.977135:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1785393644.977151:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1785393644.982003:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1785393644.982165:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1785393644.982941:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1785393644.982959:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1785393644.982965:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1785393644.983076:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1785393644.983103:0:5812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1785393644.983107:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1785393644.983108:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785393644.983110:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785393644.983111:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785393644.983112:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785393644.983113:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785393644.983114:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785393644.983115:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785393644.983116:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785393644.983117:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785393644.983119:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785393644.983120:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785393644.983122:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1785393644.983124:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785393644.983125:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785393644.983126:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785393644.983127:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785393644.983129:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785393644.983130:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785393644.983131:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785393644.983132:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785393644.983133:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785393644.983134:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785393644.983134:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785393644.983135:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785393644.983163:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1785393644.983175:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b36caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279360:0@lo:253: 00000100:00100000:2.0:1785393644.983234:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393644.983274:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d23bb5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1785393644.983450:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279360 00000100:00100000:0.0:1785393644.983461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279360 00000100:00100000:0.0:1785393644.983499:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785393644.983505:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d77a650f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5812:x1872120831279360:12345-0@lo:253: 20000000:01000000:0.0:1785393644.983542:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785393644.983545:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1785393644.983967:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1785393644.984022:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1785393644.984278:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785393644.986371:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1785393644.986532:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785393644.986536:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1785393644.986540:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1785393644.986543:0:5826:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1785393644.986554:0:5826:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1785393644.986770:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785393644.986982:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1785393644.986993:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1785393644.987046:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1785393644.987101:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1785393644.987136:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1785393644.987221:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1785393644.987229:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1785393644.987267:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1785393644.987273:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1785393644.987298:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1785393644.987304:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1785393644.987328:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1785393644.987366:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1785393644.987391:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1785393644.987395:0:5826:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1785393644.987406:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785393644.987601:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1785393644.987610:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1785393644.987638:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1785393644.987666:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1785393644.987716:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1785393644.987727:0:5826:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1785393644.987788:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1785393644.987795:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1785393644.987830:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1785393644.987860:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1785393644.987887:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1785393644.987897:0:5826:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1785393644.987962:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1785393644.987969:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1785393644.987995:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1785393644.988037:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1785393644.988169:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1785393644.988209:0:5826:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1785393644.988216:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1785393644.991697:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1785393644.992111:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1785393644.992132:0:5826:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:0.0:1785393644.992135:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:0.0:1785393644.992164:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1785393644.992170:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1785393644.992194:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1785393644.992200:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:0.0:1785393644.992236:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1785393644.992244:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1785393644.992270:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1785393644.992319:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1785393644.992369:0:5826:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1785393644.992372:0:5826:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1785393644.992376:0:5826:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1785393644.992385:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785393644.992387:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1785393644.992418:0:5826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1785393644.992420:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1785393644.996704:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1785393644.997142:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1785393644.997186:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1785393644.997267:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1785393644.997280:0:5826:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1785393644.997282:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785393644.998125:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1785393644.998335:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1785393644.998370:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1785393644.998953:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1785393644.998971:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785393644.998974:0:5826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1785393644.998979:0:5826:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1785393644.998981:0:5826:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1785393644.998986:0:5826:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1785393644.998991:0:5826:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1785393645.008405:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1785393645.009041:0:5826:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1785393645.024037:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1785393645.024083:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1785393645.024148:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1785393645.024168:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1785393645.024185:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024217:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024225:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024231:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024237:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024243:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024249:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6638458 already unused, calling callback (00000000530e3a82) 00010000:00010000:1.0:1785393645.024252:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024259:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024270:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024275:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.024281:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785393645.024303:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1785393645.443203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d77a650f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5812:x1872120831279360:12345-0@lo:253: Request processed in 459690us (459961us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.443233:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393645.443773:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b36caa9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279360:0@lo:253: 10000000:01000000:3.0:1785393645.443788:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1785393645.443792:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785393645.443794:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785393645.443795:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393645.443796:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1785393645.443797:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393645.443798:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393645.443799:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785393645.443801:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785393645.443802:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1785393645.443804:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393645.443805:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785393645.443821:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000193741fd from lustre-MDT0000 10000000:01000000:3.0:1785393645.443854:0:5812:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1785393645.443862:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1785393645.443866:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93acc9538000 10000000:01000000:3.0:1785393645.443870:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785393645.443878:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93acc9538000 from 1 10000000:01000000:3.0:1785393645.443881:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1785393645.443928:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.443939:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.443947:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393645.443963:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dff6464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279488:0@lo:101: 00000100:00100000:3.0:1785393645.443999:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.444063:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b417308f going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.444208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279488 00000100:00100000:0.0:1785393645.444214:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279488 00000100:00100000:0.0:1785393645.444254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785393645.444261:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052067d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5812:x1872120831279488:12345-0@lo:101: 00010000:00010000:0.0:1785393645.444274:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393645.444286:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002329c489/0xcc9b96d8b36296e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36296d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.444307:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002329c489/0xcc9b96d8b36296e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.444317:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002329c489/0xcc9b96d8b36296e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.444326:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002329c489, rc 0) 00000100:00100000:0.0:1785393645.444367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052067d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5812:x1872120831279488:12345-0@lo:101: Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.444372:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785393645.444453:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dff6464 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279488:0@lo:101: 00010000:00010000:2.0:1785393645.444466:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.444473:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.444516:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279616:0@lo:501: 00000100:00100000:2.0:1785393645.444543:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.444567:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aba3ecd5 going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.444708:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279616 00000100:00100000:1.0:1785393645.444712:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279616 00000100:00100000:1.0:1785393645.444753:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785393645.444760:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc227fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5812:x1872120831279616:12345-0@lo:501: 00000100:00100000:1.0:1785393645.444986:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc227fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5812:x1872120831279616:12345-0@lo:501: Request processed in 226us (442us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785393645.444993:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785393645.445119:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279616:0@lo:501: 10000000:01000000:2.0:1785393645.445144:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1785393645.445164:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445171:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008e16eba6/0xcc9b96d8b36296d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393645.445178:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ace0136800 10000000:01000000:2.0:1785393645.445181:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1785393645.445185:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ace0136800 10000000:01000000:2.0:1785393645.445187:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1785393645.445189:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93ace0136800 from 1 10000000:01000000:2.0:1785393645.445190:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1785393645.445205:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445220:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445227:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.445238:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279744:0@lo:101: 00000100:00100000:2.0:1785393645.445262:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.445280:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aba3ecd5 going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.445337:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279744 00000100:00100000:1.0:1785393645.445341:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279744 00000100:00100000:1.0:1785393645.445357:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785393645.445362:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e395e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5812:x1872120831279744:12345-0@lo:101: 00010000:00010000:1.0:1785393645.445368:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393645.445378:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36296e7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.445389:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36296e7 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.445396:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6638458/0xcc9b96d8b36296ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36296e7 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.445403:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6638458, rc 0) 00000100:00100000:1.0:1785393645.445446:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e395e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:5812:x1872120831279744:12345-0@lo:101: Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393645.445451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785393645.445846:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279744:0@lo:101: 00010000:00010000:2.0:1785393645.445856:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445863:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393645.445873:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1785393645.445885:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445891:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000084b8d616/0xcc9b96d8b36296e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393645.445897:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1785393645.445900:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785393645.445904:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ace0136800 10000000:01000000:2.0:1785393645.445907:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1785393645.445909:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1785393645.445917:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785393645.445931:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445936:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.445942:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.445952:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279872:0@lo:101: 00000100:00100000:2.0:1785393645.445976:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.445995:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aba3ecd5 going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.446019:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831279872 00000100:00100000:2.0:1785393645.446023:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831279872 00000100:00100000:2.0:1785393645.446040:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785393645.446045:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000281dcd4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:5812:x1872120831279872:12345-0@lo:101: 00010000:00010000:2.0:1785393645.446052:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393645.446059:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a909afae/0xcc9b96d8b36296fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36296f5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.446071:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a909afae/0xcc9b96d8b36296fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.446077:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a909afae/0xcc9b96d8b36296fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.446084:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a909afae, rc 0) 00000100:00100000:2.0:1785393645.446109:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000281dcd4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+8:5812:x1872120831279872:12345-0@lo:101: Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.446123:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785393645.446151:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831279872:0@lo:101: 00010000:00010000:2.0:1785393645.446159:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.446165:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.446199:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280000:0@lo:501: 00000100:00100000:2.0:1785393645.446222:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.446233:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aba3ecd5 going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.446243:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280000 00000100:00100000:2.0:1785393645.446246:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280000 00000100:00100000:2.0:1785393645.446261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785393645.446265:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd03dfac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+8:5812:x1872120831280000:12345-0@lo:501: 00000100:00100000:2.0:1785393645.446419:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd03dfac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5812:x1872120831280000:12345-0@lo:501: Request processed in 153us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.446426:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785393645.447113:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020a197c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280000:0@lo:501: 00000100:00100000:3.0:1785393645.447143:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000124f051 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280128:0@lo:503: 00000100:00100000:3.0:1785393645.447181:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.447209:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e7f60f3 going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.447259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280128 00000100:00100000:0.0:1785393645.447264:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280128 00000100:00100000:0.0:1785393645.447292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785393645.447299:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbc0952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:5812:x1872120831280128:12345-0@lo:503: 00000100:00100000:0.0:1785393645.447602:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbc0952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5812:x1872120831280128:12345-0@lo:503: Request processed in 303us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.447609:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785393645.449474:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000124f051 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280128:0@lo:503: 00000100:00100000:1.0:1785393645.450976:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5854:1872120831280256:0@lo:502: 00000100:00100000:1.0:1785393645.451055:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393645.451107:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9ef26d6 going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.451191:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280256 00000100:00100000:2.0:1785393645.451198:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280256 00000100:00100000:2.0:1785393645.451232:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785393645.451239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ecf17ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5854:x1872120831280256:12345-0@lo:502: 00000100:00100000:2.0:1785393645.451442:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ecf17ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5854:x1872120831280256:12345-0@lo:502: Request processed in 203us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.451449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785393645.453227:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5854:1872120831280256:0@lo:502: 00000020:01000000:1.0:1785393645.453260:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785393645.453271:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393645.453273:0:5854:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785393645.453277:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1785393645.453280:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785393645.453301:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001b67b7cf) 00000020:00000080:1.0:1785393645.453319:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1785393645.453323:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1785393645.453424:0:5854:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1785393645.453429:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362970a 00000020:00000080:1.0:1785393645.453642:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1785393645.453647:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393645.453650:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393645.453651:0:5854:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785393645.453654:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785393645.453657:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393645.453658:0:5854:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1785393645.453662:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785393645.453666:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c94ea15c) 00000020:00000080:1.0:1785393645.453675:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1785393645.453678:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1785393645.453680:0:5854:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1785393645.453682:0:5854:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1785393645.453687:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1785393645.453723:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000193741fd from lustre-MDT0000, refs=3 00000020:00000080:1.0:1785393645.453861:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005b16a134) 00000020:00000080:1.0:1785393645.453869:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1785393645.453929:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1785393645.453934:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362971f 00000020:00000080:1.0:1785393645.454038:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1785393645.454045:0:5854:0:(mdd_device.c:1597:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1785393645.454049:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc9b96d8b3629726 00080000:01000000:1.0:1785393645.454054:0:5854:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1785393645.454057:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362972d 00080000:10000000:1.0:1785393645.454990:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1785393645.455201:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1785393645.458264:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1785393645.520987:0:5854:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1785393645.521730:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1785393645.524548:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1785393645.525196:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1785393645.552224:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b72e90f4) 00000020:00000080:2.0:1785393645.552245:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1785393645.552316:0:5854:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1785393645.552324:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362973b 00000020:00000080:3.0:1785393645.553018:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1785393645.554533:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393645.572819:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393645.592960:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393645.617206:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:1.0:1785393645.664495:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1785393645.686494:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1785393645.732233:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1785393645.767185:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc9b96d8b3629742 00000020:00000080:0.0:1785393645.767830:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1785393645.767934:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393645.767942:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393645.767944:0:5854:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1785393645.767948:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393645.767951:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393645.767953:0:5854:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785393645.767956:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785393645.767958:0:5854:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785393645.767960:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393645.767963:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393645.767964:0:5854:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785393645.767967:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393645.767971:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393645.767973:0:5854:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1785393645.767976:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1785393645.768016:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1785393645.768075:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a440787d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5854:1872120831280384:0@lo:502: 00000100:00100000:0.0:1785393645.768155:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393645.768241:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set 000000008e19eeb1 going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.768343:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280384 00000100:00100000:1.0:1785393645.768350:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280384 00000100:00100000:1.0:1785393645.768381:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785393645.768388:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3145c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5854:x1872120831280384:12345-0@lo:502: 00000100:00100000:1.0:1785393645.768935:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3145c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5854:x1872120831280384:12345-0@lo:502: Request processed in 546us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393645.768944:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785393645.769231:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a440787d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5854:1872120831280384:0@lo:502: 00000020:01000000:0.0:1785393645.769255:0:5854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393645.769260:0:5854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393645.769262:0:5854:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1785393645.769265:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1785393645.769481:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1785393645.769499:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785393645.769516:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.769526:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000077089ddf/0xcc9b96d8b36296f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393645.769533:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ace0136800 from 1 10000000:01000000:1.0:1785393645.769536:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785393645.769767:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.769792:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.769800:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393645.769820:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280512:0@lo:101: 00000100:00100000:1.0:1785393645.769986:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393645.770050:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280512 00000100:00100000:0.0:1785393645.770055:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280512 00000100:00100000:0.0:1785393645.770080:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785393645.770087:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ee28bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:5812:x1872120831280512:12345-0@lo:101: 00010000:00010000:0.0:1785393645.770096:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393645.770107:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629749 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.770135:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.770144:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.770152:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d20ce14, rc 0) 00000100:00100000:0.0:1785393645.770176:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ee28bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:5812:x1872120831280512:12345-0@lo:101: Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.770182:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785393645.770364:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a17d818 going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.770379:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280512:0@lo:101: 00010000:00010000:1.0:1785393645.770389:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.770397:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393645.773491:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280640:0@lo:256: 00000100:00100000:1.0:1785393645.773553:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393645.774208:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a17d818 going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.774254:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280640 00000100:00100000:0.0:1785393645.774260:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280640 00000100:00100000:0.0:1785393645.774301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785393645.774308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0be1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:5812:x1872120831280640:12345-0@lo:256: 20000000:01000000:0.0:1785393645.774327:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1785393645.774332:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1785393645.774395:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0be1dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:5812:x1872120831280640:12345-0@lo:256: Request processed in 87us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.774402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785393645.774666:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f840fe3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280640:0@lo:256: 10000000:01000000:3.0:1785393645.775479:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785393645.775526:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.775537:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393645.775544:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ace0136800 from 1 10000000:01000000:3.0:1785393645.775547:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785393645.775598:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.775605:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.775612:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393645.775628:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280768:0@lo:101: 00000100:00100000:3.0:1785393645.775661:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.775691:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000008696b8ec going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.775797:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280768 00000100:00100000:2.0:1785393645.775803:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280768 00000100:00100000:2.0:1785393645.775844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785393645.775851:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fd9e464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:5812:x1872120831280768:12345-0@lo:101: 00010000:00010000:2.0:1785393645.775860:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393645.775870:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629757 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.775889:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.775898:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.775906:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000128c59da, rc 0) 00000100:00100000:2.0:1785393645.775939:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fd9e464 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831280768:12345-0@lo:101: Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.775945:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393645.776102:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280768:0@lo:101: 00010000:00010000:3.0:1785393645.776114:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.776132:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393645.776177:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280896:0@lo:501: 00000100:00100000:3.0:1785393645.776206:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.776233:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000008696b8ec going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.776327:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831280896 00000100:00100000:1.0:1785393645.776331:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831280896 00000100:00100000:1.0:1785393645.776358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785393645.776364:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003114d228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831280896:12345-0@lo:501: 00000100:00100000:1.0:1785393645.776861:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003114d228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831280896:12345-0@lo:501: Request processed in 497us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393645.776868:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393645.777089:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831280896:0@lo:501: 00000100:00100000:3.0:1785393645.777113:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281024:0@lo:503: 00000100:00100000:3.0:1785393645.777207:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.777232:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000008696b8ec going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.777352:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281024 00000100:00100000:2.0:1785393645.777357:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281024 00000100:00100000:2.0:1785393645.777391:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785393645.777397:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074832f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831281024:12345-0@lo:503: 00000040:00080000:2.0:1785393645.777436:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785393645.777473:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074832f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831281024:12345-0@lo:503: Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.777480:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785393645.779038:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000835f5e65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281024:0@lo:503: 00000040:00080000:3.0:1785393645.781011:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1785393645.781239:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1785393645.781258:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785393645.781276:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.781288:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393645.781326:0:5812:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1785393645.781328:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ace0136800 10000000:01000000:2.0:1785393645.781332:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ace0136800 10000000:01000000:2.0:1785393645.781335:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785393645.781340:0:5812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ace0136800 from 1 10000000:01000000:2.0:1785393645.781343:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785393645.781369:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.781376:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.781384:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.781402:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281152:0@lo:101: 00000100:00100000:2.0:1785393645.781452:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.781551:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1e928a5 going to sleep for 11 seconds 00000100:00100000:3.0:1785393645.781748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281152 00000100:00100000:3.0:1785393645.781755:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281152 00000100:00100000:3.0:1785393645.781832:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393645.781904:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004be765eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831281152:12345-0@lo:101: 00010000:00010000:3.0:1785393645.781917:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393645.781930:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6c723e9/0xcc9b96d8b362976c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629765 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.781950:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6c723e9/0xcc9b96d8b362976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.781958:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6c723e9/0xcc9b96d8b362976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.781966:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6c723e9, rc 0) 00000100:00100000:3.0:1785393645.782002:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004be765eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281152:12345-0@lo:101: Request processed in 102us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393645.782018:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785393645.782085:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281152:0@lo:101: 00010000:00010000:2.0:1785393645.782110:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.782130:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393645.782173:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281280:0@lo:501: 00000100:00100000:2.0:1785393645.782198:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.782421:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1e928a5 going to sleep for 11 seconds 00000100:00100000:1.0:1785393645.782464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281280 00000100:00100000:1.0:1785393645.782469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281280 00000100:00100000:0.0:1785393645.782504:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785393645.782513:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d402cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281280:12345-0@lo:501: 00000100:00100000:0.0:1785393645.782757:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d402cb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281280:12345-0@lo:501: Request processed in 246us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.782763:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785393645.782830:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281280:0@lo:501: 00000100:00100000:2.0:1785393645.782942:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281408:0@lo:503: 00000100:00100000:2.0:1785393645.782975:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393645.782999:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1e928a5 going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.783048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281408 00000100:00100000:0.0:1785393645.783053:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281408 00000100:00100000:0.0:1785393645.783079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785393645.783084:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3df5093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281408:12345-0@lo:503: 00000100:00100000:0.0:1785393645.783454:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3df5093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281408:12345-0@lo:503: Request processed in 369us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.783462:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1785393645.783513:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281408:0@lo:503: 00000100:00100000:1.0:1785393645.784033:0:5860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038fb7256 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5860:1872120831281536:0@lo:502: 00000100:00100000:1.0:1785393645.784068:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393645.784094:0:5860:0:(client.c:2702:ptlrpc_set_wait()) set 0000000038236436 going to sleep for 11 seconds 00000100:00100000:3.0:1785393645.784187:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281536 00000100:00100000:3.0:1785393645.784198:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281536 00000100:00100000:3.0:1785393645.784230:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785393645.784237:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc6ed1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5860:x1872120831281536:12345-0@lo:502: 00000100:00100000:3.0:1785393645.784444:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc6ed1a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5860:x1872120831281536:12345-0@lo:502: Request processed in 208us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393645.784451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785393645.784540:0:5860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038fb7256 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5860:1872120831281536:0@lo:502: 00000020:01000004:1.0:1785393645.784623:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1785393645.784637:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009d5b5437) 00000020:00000080:1.0:1785393645.784653:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1785393645.784789:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000193741fd from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785393645.784793:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000193741fd from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785393645.784795:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000193741fd 4 00010000:00080000:0.0:1785393645.786703:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067109266@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1785393645.790333:0:5860:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1785393645.790441:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1785393645.790479:0:5860:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1785393645.790490:0:5860:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc9b96d8b362977a 00000100:00080000:0.0:1785393645.790498:0:5860:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785393645.790502:0:5860:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067109266 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1785393645.790532:0:5860:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a440787d x1872120831281664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785393645.790606:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a440787d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831281664:0@lo:38: 00000100:00100000:3.0:1785393645.790671:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785393645.790747:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785393645.790976:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281664 00000100:00100000:1.0:1785393645.790983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281664 00000100:00100000:1.0:1785393645.791199:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393645.791205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000835f5e65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831281664:12345-0@lo:38: 00000100:00100000:0.0:1785393645.791916:0:5860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096be8299 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5860:1872120831281792:0@lo:502: 00000100:00100000:0.0:1785393645.791964:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393645.791987:0:5860:0:(client.c:2702:ptlrpc_set_wait()) set 000000006b7c91eb going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.791999:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281792 00000100:00100000:0.0:1785393645.792003:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281792 00000100:00100000:0.0:1785393645.792042:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785393645.792048:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bff46572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5860:x1872120831281792:12345-0@lo:502: 00000100:00100000:0.0:1785393645.792379:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bff46572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5860:x1872120831281792:12345-0@lo:502: Request processed in 330us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393645.792386:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785393645.792438:0:5860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096be8299 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5860:1872120831281792:0@lo:502: 00000040:00080000:0.0:1785393645.792463:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1785393645.792607:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1785393645.792630:0:5812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785393645.792647:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393645.792657:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000003a2d86aa/0xcc9b96d8b3629765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785393645.792696:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785393645.792699:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785393645.792700:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393645.792701:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785393645.792702:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393645.792704:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393645.792705:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785393645.792706:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785393645.792708:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785393645.792709:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785393645.792710:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393645.792712:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785393645.792715:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1785393645.792718:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785393645.792719:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785393645.792719:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393645.792720:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785393645.792724:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393645.792725:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393645.792726:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785393645.792727:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785393645.792728:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785393645.792728:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785393645.792729:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393645.792730:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785393645.792743:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785393645.792751:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000cd8e490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281920:0@lo:253: 00000100:00100000:3.0:1785393645.795335:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393645.795371:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000008696b8ec going to sleep for 11 seconds 00000100:00100000:0.0:1785393645.795374:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831281920 00000100:00100000:0.0:1785393645.795382:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831281920 00000100:00100000:0.0:1785393645.795461:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785393645.795465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000835f5e65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831281664:12345-0@lo:38: Request processed in 4210us (4745us total) trans 0 rc -11/-11 00000100:00100000:0.0:1785393645.795471:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ec0ef3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5812:x1872120831281920:12345-0@lo:253: 00000100:00100000:1.0:1785393645.795479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:0.0:1785393645.795496:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1785393645.795508:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1785393645.795521:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785393645.795528:0:3314:0:(import.c:65:import_set_state_nolock()) 0000000067109266 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785393645.795532:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1785393645.795535:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a440787d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831281664:0@lo:38: 20000000:01000000:3.0:1785393645.857778:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785393645.857799:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1785393645.857909:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785393645.857914:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785393645.857933:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.857949:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.857956:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.857990:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393645.858014:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 12 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393645.858027:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096be8299 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831282048:0@lo:104: 00000100:00100000:0.0:1785393645.858093:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393645.858817:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set 00000000405b0e0b going to sleep for 11 seconds 00000100:00100000:2.0:1785393645.859666:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282048 00000100:00100000:2.0:1785393645.859674:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282048 00000100:00100000:2.0:1785393645.859720:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785393645.859726:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026558ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831282048:12345-0@lo:104: 00010000:00010000:2.0:1785393645.859738:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859805:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785393645.859810:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026558ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831282048:12345-0@lo:104: Request processed in 84us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393645.859816:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1785393645.859834:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393645.859838:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859852:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000f69a760 already unused, calling callback (000000007f302d6a) 10000000:00010000:2.0:1785393645.859854:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859861:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393645.859866:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393645.859870:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1785393645.859897:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859902:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393645.859916:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859921:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000000f69a760/0xcc9b96d8b3629749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629750 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393645.859933:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393645.859935:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393645.859936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393645.860020:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831282176:0@lo:103: 00000100:00100000:2.0:1785393645.860048:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393645.860325:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282176 00000100:00100000:1.0:1785393645.860330:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282176 00010000:00010000:1.0:1785393645.860346:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 13 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393645.860367:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393645.860376:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056aedcff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3316:x1872120831282176:12345-0@lo:103: 00010000:00010000:1.0:1785393645.860396:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393645.860400:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 13 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860410:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 13 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860424:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860431:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785393645.860443:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002529611s 00010000:00010000:1.0:1785393645.860446:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860452:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860459:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860464:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860469:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012957ff6 already unused, calling callback (00000000530e3a82) 00010000:00010000:1.0:1785393645.860472:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860478:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860490:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860502:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393645.860529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056aedcff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3316:x1872120831282176:12345-0@lo:103: Request processed in 153us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393645.860535:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393645.860564:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005090212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831282176:0@lo:103: 00010000:00010000:1.0:1785393645.860607:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d20ce14/0xcc9b96d8b3629750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629749 expref: 12 pid: 5825 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393645.860617:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096be8299 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831282048:0@lo:104: 00010000:00010000:1.0:1785393645.860629:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860636:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860641:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393645.860646:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629781 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393645.882466:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ec0ef3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5812:x1872120831281920:12345-0@lo:253: Request processed in 86992us (87127us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393645.882481:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785393645.882771:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000cd8e490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5812:1872120831281920:0@lo:253: 10000000:01000000:0.0:1785393645.882786:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1785393645.882789:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785393645.882791:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785393645.882792:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785393645.882793:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785393645.882795:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785393645.882796:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785393645.882797:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785393645.882798:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785393645.882800:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785393645.882801:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785393645.882802:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785393645.882803:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1785393645.882816:0:5812:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1785393645.893666:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1785393645.895677:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1785393645.896730:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1785393645.897607:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1785393645.897863:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393645.905230:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1785393645.907679:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393645.907873:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1785393645.908816:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393645.909280:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1785393645.910978:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393645.911346:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1785393645.972253:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1785393646.038529:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1785393646.038888:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1785393646.040281:0:5865:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1785393646.040286:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1785393646.045095:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1785393646.045667:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1785393646.046981:0:5812:0:(mdd_device.c:554:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1785393646.046991:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1785393646.047617:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785393646.050039:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1785393646.052414:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1785393646.056955:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1785393646.057220:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1785393646.057426:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1785393646.058805:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1785393646.058967:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1785393646.059395:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1785393646.059546:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1785393646.059815:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1785393646.060021:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1785393646.060151:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1785393646.060282:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1785393646.060416:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1785393646.060549:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1785393646.060808:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1785393646.060965:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1785393646.061116:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1785393646.061276:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1785393646.061414:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1785393646.061565:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1785393646.061942:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1785393646.062100:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1785393646.062232:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1785393646.062388:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1785393646.062512:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1785393646.062760:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1785393646.062916:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1785393646.063068:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1785393646.063199:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1785393646.063358:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1785393646.063491:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1785393646.064061:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1785393646.064196:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1785393646.064348:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1785393646.064497:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1785393646.064673:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1785393646.065480:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1785393646.127430:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1785393646.167083:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1785393646.167117:0:5812:0:(mdd_device.c:2303:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa33d01cbf988 00100000:10000000:2.0:1785393646.167125:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1785393646.168643:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1785393646.168657:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1785393646.168668:0:5812:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1785393646.168693:0:5812:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1785393646.238468:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1785393646.238532:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1785393646.238537:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1785393646.692891:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393647.713151:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393648.737809:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393649.766870:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393650.784385:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393651.239479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1785393651.239489:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1785393651.239492:0:36:0:(import.c:65:import_set_state_nolock()) 0000000067109266 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785393651.239505:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067109266 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1785393651.239526:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000059ebbaf4 x1872120831282432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785393651.239675:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000038cef5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831282304:0@lo:400: 00000100:00100000:1.0:1785393651.239751:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393651.239830:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059ebbaf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831282432:0@lo:38: 00000100:00100000:1.0:1785393651.240098:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393651.240182:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282304 00000100:00100000:2.0:1785393651.240189:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282304 00000100:00100000:2.0:1785393651.240235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785393651.240257:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000887a9afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:3317:x1872120831282304:12345-0@lo:400: 00000100:00100000:3.0:1785393651.240276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282432 00000100:00100000:3.0:1785393651.240282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282432 00000100:00100000:2.0:1785393651.240311:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000887a9afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:3317:x1872120831282304:12345-0@lo:400: Request processed in 56us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393651.240315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393651.240327:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038fb7256 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1872120831282432:12345-0@lo:38: 00000100:00100000:2.0:1785393651.240328:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1785393651.240353:0:5833:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1785393651.240422:0:5833:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc9b96d8b3629788 00000004:00100000:2.0:1785393651.240467:0:5833:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1785393651.240590:0:5833:0:(import.c:65:import_set_state_nolock()) 000000001188c841 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785393651.240634:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038fb7256 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872120831282432:12345-0@lo:38: Request processed in 311us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393651.240644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785393651.241985:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000059ebbaf4 x1872120831282432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785393661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785393651.242002:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1785393651.242010:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1785393651.242015:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1785393651.242017:0:3314:0:(import.c:65:import_set_state_nolock()) 0000000067109266 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1785393651.242022:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059ebbaf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831282432:0@lo:38: 00000100:00100000:1.0:1785393651.242988:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000038cef5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831282304:0@lo:400: 00010000:00010000:2.0:1785393651.808657:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785393652.144448:0:6108:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1785393652.831806:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785393653.280098:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785393653.280106:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ace0136800 from 3 10000000:01000000:2.0:1785393653.280110:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785393653.280152:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393653.280165:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393653.280175:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393653.280198:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aeb5971c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831282560:0@lo:101: 00000100:00100000:2.0:1785393653.280263:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393653.280889:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set 000000007a6b027a going to sleep for 11 seconds 00000100:00100000:0.0:1785393653.284040:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282560 00000100:00100000:0.0:1785393653.284053:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282560 00000100:00100000:0.0:1785393653.284166:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785393653.284176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4dfd8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5828:x1872120831282560:12345-0@lo:101: 00010000:00010000:0.0:1785393653.284192:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393653.284208:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362978f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393653.284250:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393653.284260:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012957ff6/0xcc9b96d8b3629796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393653.284268:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012957ff6, rc 0) 00000100:00100000:0.0:1785393653.284342:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4dfd8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831282560:12345-0@lo:101: Request processed in 168us (4080us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393653.284349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785393653.284424:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aeb5971c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831282560:0@lo:101: 00010000:00010000:1.0:1785393653.284441:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393653.284449:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393653.284505:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831282688:0@lo:256: 00000100:00100000:1.0:1785393653.284543:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393653.294113:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b2254dd3 going to sleep for 11 seconds 00000100:00100000:2.0:1785393653.298099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282688 00000100:00100000:2.0:1785393653.298112:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282688 00000100:00100000:2.0:1785393653.298158:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393653.298180:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000028ad176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831282688:12345-0@lo:256: 20000000:01000000:2.0:1785393653.298204:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785393653.298217:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785393653.298220:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1785393653.298329:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000028ad176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831282688:12345-0@lo:256: Request processed in 150us (13785us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393653.298336:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785393653.298816:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831282688:0@lo:256: 10000000:01000000:1.0:1785393653.298998:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785393653.299007:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393653.299021:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000007a28a1fd/0xcc9b96d8b362978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393653.855665:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393654.880597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393655.919989:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393656.352265:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3be8896 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831282944:0@lo:400: 00000100:00100000:2.0:1785393656.352341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393656.353027:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077a5954a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831282816:0@lo:400: 00000100:00100000:1.0:1785393656.353065:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393656.353113:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282944 00000100:00100000:1.0:1785393656.353121:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282944 00000100:00100000:1.0:1785393656.353165:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393656.353172:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066239c0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831282944:12345-0@lo:400: 00000100:00100000:1.0:1785393656.353219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066239c0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831282944:12345-0@lo:400: Request processed in 48us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393656.353226:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785393656.353260:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c3be8896 x1872120831282944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393656.353272:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3be8896 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831282944:0@lo:400: 00000100:00100000:2.0:1785393656.353426:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831282816 00000100:00100000:2.0:1785393656.353431:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831282816 00000100:00100000:2.0:1785393656.353461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785393656.353466:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000009f4bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3318:x1872120831282816:12345-0@lo:400: 00000100:00100000:2.0:1785393656.353499:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000009f4bd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3318:x1872120831282816:12345-0@lo:400: Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393656.353505:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785393656.353731:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077a5954a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831282816:0@lo:400: 00010000:00010000:2.0:1785393656.927686:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393657.960079:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785393658.533840:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd53f62fe0 20000000:00000080:3.0:1785393658.533856:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acf9552000 uarg=0000000000000000 20000000:01000000:3.0:1785393658.533886:0:6311:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1785393658.533892:0:6311:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1785393658.533896:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1785393658.534083:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1785393658.534095:0:6311:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1785393658.550852:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785393658.551701:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785393658.551769:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1785393658.551821:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1785393658.551838:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785393658.551855:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.551873:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.551880:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.551917:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.553094:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 11 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393658.553109:0:6311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065d7ee44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1872120831283072:0@lo:104: 00000100:00100000:3.0:1785393658.553168:0:6311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393658.553779:0:6311:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac79eb3f going to sleep for 11 seconds 00000100:00100000:1.0:1785393658.553857:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283072 00000100:00100000:1.0:1785393658.553865:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283072 00000100:00100000:1.0:1785393658.553905:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785393658.553912:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000502b5cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:6311:x1872120831283072:12345-0@lo:104: 00010000:00010000:1.0:1785393658.553932:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.554059:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785393658.554064:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000502b5cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:6311:x1872120831283072:12345-0@lo:104: Request processed in 153us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393658.554070:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1785393658.554090:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393658.554101:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393658.554115:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008db824ef already unused, calling callback (000000007f302d6a) 10000000:00010000:2.0:1785393658.554119:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393658.554129:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393658.554154:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393658.554161:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393658.554216:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393658.554223:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393658.554255:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393658.554262:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000008db824ef/0xcc9b96d8b3629757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362975e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393658.554283:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393658.554285:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393658.554286:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393658.554295:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393658.554313:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000de3a37c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831283200:0@lo:103: 00000100:00100000:3.0:1785393658.554368:0:6311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065d7ee44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1872120831283072:0@lo:104: 00010000:00010000:3.0:1785393658.554387:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393658.555082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393658.555948:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283200 00000100:00100000:1.0:1785393658.555955:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283200 00010000:00010000:1.0:1785393658.555989:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 12 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393658.556018:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785393658.556025:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9546d18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3315:x1872120831283200:12345-0@lo:103: 00010000:00010000:1.0:1785393658.556036:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393658.556040:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 12 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556049:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 12 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556062:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000128c59da/0xcc9b96d8b362975e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629757 expref: 12 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556076:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556083:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556095:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556114:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556119:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556124:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556128:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d96afdc9 already unused, calling callback (00000000530e3a82) 00010000:00010000:1.0:1785393658.556130:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556136:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556152:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393658.556160:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393658.556227:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9546d18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:3315:x1872120831283200:12345-0@lo:103: Request processed in 196us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393658.556235:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1785393658.556379:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.556386:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393658.556391:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d96afdc9/0xcc9b96d8b362979d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393658.556451:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000de3a37c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831283200:0@lo:103: 00010000:00010000:1.0:1785393658.978732:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393660.003506:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393661.024968:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785393661.411699:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785393661.411708:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ace0136800 from 1 10000000:01000000:2.0:1785393661.411714:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785393661.411776:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008fd3f07e/0xcc9b96d8b36297a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393661.411791:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008fd3f07e/0xcc9b96d8b36297a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393661.411818:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008fd3f07e/0xcc9b96d8b36297a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393661.411847:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000de3a37c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283328:0@lo:101: 00000100:00100000:2.0:1785393661.411955:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393661.412007:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set 00000000236f3f54 going to sleep for 11 seconds 00000100:00100000:3.0:1785393661.417721:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283328 00000100:00100000:3.0:1785393661.417973:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283328 00000100:00100000:3.0:1785393661.418055:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785393661.418065:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d822b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:5828:x1872120831283328:12345-0@lo:101: 00010000:00010000:3.0:1785393661.418088:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393661.418112:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000042d9480/0xcc9b96d8b36297ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36297a4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393661.418146:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000042d9480/0xcc9b96d8b36297ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393661.418176:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000042d9480/0xcc9b96d8b36297ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393661.418186:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000042d9480, rc 0) 00000100:00100000:3.0:1785393661.419790:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d822b1e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831283328:12345-0@lo:101: Request processed in 1723us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393661.419800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785393661.424152:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000de3a37c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283328:0@lo:101: 00010000:00010000:1.0:1785393661.424191:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008fd3f07e/0xcc9b96d8b36297a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393661.424230:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008fd3f07e/0xcc9b96d8b36297a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393661.424330:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283456:0@lo:501: 00000100:00100000:1.0:1785393661.424404:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393661.424467:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0650a8b going to sleep for 11 seconds 00000100:00100000:0.0:1785393661.427007:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283456 00000100:00100000:0.0:1785393661.427026:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283456 00000100:00100000:0.0:1785393661.427097:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785393661.427108:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ca76a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831283456:12345-0@lo:501: 00000100:00100000:0.0:1785393661.427480:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ca76a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831283456:12345-0@lo:501: Request processed in 373us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393661.427489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785393661.427890:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283456:0@lo:501: 00000100:00100000:1.0:1785393661.428014:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283584:0@lo:503: 00000100:00100000:1.0:1785393661.428066:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393661.428151:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0650a8b going to sleep for 11 seconds 00000100:00100000:2.0:1785393661.436552:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283584 00000100:00100000:2.0:1785393661.436589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283584 00000100:00100000:0.0:1785393661.440313:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785393661.440330:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ad730b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831283584:12345-0@lo:503: 00000100:00100000:0.0:1785393661.440632:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ad730b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831283584:12345-0@lo:503: Request processed in 306us (12566us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393661.440641:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785393661.440794:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831283584:0@lo:503: 00000100:00100000:1.0:1785393661.441954:0:6379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6379:1872120831283712:0@lo:502: 00000100:00100000:1.0:1785393661.442023:0:6379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393661.442113:0:6379:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b6c04762 going to sleep for 11 seconds 00000100:00100000:0.0:1785393661.447872:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283712 00000100:00100000:0.0:1785393661.447892:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283712 00000100:00100000:0.0:1785393661.447970:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785393661.448008:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002586ad0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6379:x1872120831283712:12345-0@lo:502: 00000100:00100000:0.0:1785393661.448322:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002586ad0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6379:x1872120831283712:12345-0@lo:502: Request processed in 334us (6299us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393661.448331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785393661.453021:0:6379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000266c76a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6379:1872120831283712:0@lo:502: 00000020:01000000:0.0:1785393661.453086:0:6379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393661.453101:0:6379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393661.453104:0:6379:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785393661.453112:0:6379:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ace0136800 00000020:00000080:0.0:1785393661.453116:0:6379:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785393661.453189:0:6379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6379:1872120831283840:0@lo:502: 00000100:00100000:0.0:1785393661.453283:0:6379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393661.453343:0:6379:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2f7cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785393661.453895:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283840 00000100:00100000:2.0:1785393661.453912:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283840 00000100:00100000:2.0:1785393661.453968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785393661.453978:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6379:x1872120831283840:12345-0@lo:502: 00000100:00100000:2.0:1785393661.454204:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6379:x1872120831283840:12345-0@lo:502: Request processed in 226us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393661.454212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785393661.454911:0:6379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6379:1872120831283840:0@lo:502: 00000020:01000000:0.0:1785393661.454944:0:6379:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393661.454952:0:6379:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393661.454954:0:6379:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1785393661.454958:0:6379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1785393661.455033:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1785393661.455052:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393661.455064:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393661.455077:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393661.471945:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831283968:0@lo:400: 00000100:00100000:0.0:1785393661.472047:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393661.472209:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831283968 00000100:00100000:3.0:1785393661.472219:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831283968 00000100:00100000:3.0:1785393661.472277:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393661.472289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831283968:12345-0@lo:400: 00000100:00100000:3.0:1785393661.472351:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831283968:12345-0@lo:400: Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393661.472358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785393661.472627:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acc7aca680 x1872120831283968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393661.472644:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831283968:0@lo:400: 00010000:00010000:2.0:1785393662.052367:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393663.077591:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393664.096787:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393665.121278:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393666.147215:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393666.600217:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831284224:0@lo:400: 00000100:00100000:3.0:1785393666.600304:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393666.600410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284224 00000100:00100000:3.0:1785393666.600419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284224 00000100:00100000:3.0:1785393666.600474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785393666.600484:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831284224:12345-0@lo:400: 00000100:00100000:3.0:1785393666.600541:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831284224:12345-0@lo:400: Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393666.600549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785393666.600619:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ad00210380 x1872120831284224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393666.600637:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831284224:0@lo:400: 00000100:00100000:0.0:1785393666.600778:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831284096:0@lo:400: 00000100:00100000:0.0:1785393666.600818:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393666.601014:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284096 00000100:00100000:3.0:1785393666.601018:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284096 00000100:00100000:3.0:1785393666.601051:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785393666.601058:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3318:x1872120831284096:12345-0@lo:400: 00000100:00100000:3.0:1785393666.601099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3318:x1872120831284096:12345-0@lo:400: Request processed in 42us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393666.601105:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785393666.601141:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831284096:0@lo:400: 00010000:00010000:2.0:1785393667.184198:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393668.194408:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785393668.947207:0:6627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785393668.947213:0:6627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1785393668.947397:0:6627:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93acc825e800 00000020:01000004:2.0:1785393668.947417:0:6627:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1785393668.947432:0:6627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1785393668.947450:0:6627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93acc7ad0000) 00000020:00000080:2.0:1785393668.947469:0:6627:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785393669.043338:0:6627:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1785393669.043660:0:6627:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1785393669.154359:0:6627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1785393669.188314:0:6627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785393669.188356:0:6627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1785393669.188412:0:6627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785393669.188439:0:6627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785393669.189058:0:6627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1785393669.189070:0:6627:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785393669.189086:0:6627:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc9b96d8b36297b9 00000020:01000004:3.0:1785393669.189095:0:6627:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1785393669.189119:0:6627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785393669.189124:0:6627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785393669.189130:0:6627:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1785393669.189135:0:6627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1785393669.189149:0:6627:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93acc953b380) 00000020:00000080:3.0:1785393669.189161:0:6627:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1785393669.200236:0:6627:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785393669.200433:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1785393669.200439:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1785393669.211676:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1785393669.211716:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1785393669.212406:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1785393669.212413:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1785393669.214494:0:6627:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785393669.214968:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1785393669.214975:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:0.0:1785393669.217028:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393669.228335:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1785393669.228351:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1785393669.312611:0:6627:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785393669.312910:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1785393669.312918:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1785393669.318185:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785393669.318199:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785393669.333185:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785393669.333204:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1785393669.342927:0:6627:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785393669.343147:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1785393669.343154:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1785393669.349875:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1785393669.349900:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1785393669.505353:0:6627:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785393669.506711:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1785393669.506735:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1785393669.522349:0:6627:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1785393669.522369:0:6627:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1785393669.523695:0:6627:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1785393669.523724:0:6627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1785393669.523731:0:6627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1785393669.648626:0:6627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1785393669.648669:0:6627:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1785393669.648674:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1785393669.648676:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785393669.648681:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785393669.648683:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785393669.648684:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785393669.648685:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785393669.648687:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785393669.648689:0:6627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785393669.648690:0:6627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785393669.648692:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785393669.648693:0:6627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785393669.648697:0:6627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1785393669.648699:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785393669.648701:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785393669.648702:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785393669.648703:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785393669.648704:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785393669.648705:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785393669.648706:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785393669.648707:0:6627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785393669.648708:0:6627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785393669.648709:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785393669.648710:0:6627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785393669.648740:0:6627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785393669.648762:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831284352:0@lo:253: 00000100:00100000:2.0:1785393669.648863:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393669.648925:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc3936cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393669.650255:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284352 00000100:00100000:1.0:1785393669.650266:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284352 00000100:00100000:1.0:1785393669.650332:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785393669.650343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831284352:12345-0@lo:253: 20000000:01000000:1.0:1785393669.650384:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1785393669.650389:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1785393669.650394:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1785393669.650398:0:5825:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1785393669.652983:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785393669.654502:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1785393669.655204:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1785393669.655356:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1785393669.655366:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1785393669.655401:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1785393669.655472:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1785393669.666493:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1785393669.666621:0:5825:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1785393669.666625:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1785393669.666925:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1785393669.666937:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1785393669.666996:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1785393669.667005:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1785393669.667038:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1785393669.667047:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1785393669.667079:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1785393669.667866:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1785393669.676383:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1785393669.676428:0:5825:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1785393669.676432:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1785393669.676514:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1785393669.676522:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1785393669.676566:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1785393669.691090:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1785393669.691346:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1785393669.691365:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1785393669.691419:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1785393669.691462:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1785393669.691490:0:5825:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1785393669.691494:0:5825:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1785393669.691502:0:5825:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785393669.691504:0:5825:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785393669.691507:0:5825:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785393669.691523:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785393669.691750:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785393669.691812:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785393669.691815:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785393669.694046:0:6642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1785393669.694738:0:6642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1785393669.694822:0:6642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1785393669.697400:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1785393669.697455:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1785393669.697686:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1785393669.697706:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1785393669.697709:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785393669.703031:0:6643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1785393669.703159:0:6643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1785393669.703211:0:6643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1785393669.704508:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1785393669.704626:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1785393669.705080:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1785393669.705101:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1785393669.705104:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1785393669.706151:0:6644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1785393669.707263:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1785393669.707920:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1785393669.708058:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1785393669.708086:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785393669.708111:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708142:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708151:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708158:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708165:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708212:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708229:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.708252:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284480:0@lo:104: 00000100:00100000:0.0:1785393669.708348:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785393669.708420:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708432:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 12 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.708441:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284608:0@lo:104: 00000100:00100000:0.0:1785393669.708461:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785393669.708483:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.708492:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 12 pid: 5825 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.708500:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284736:0@lo:104: 00000100:00100000:0.0:1785393669.708517:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393669.708537:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8cdb840 going to sleep for 11 seconds 00000100:00100000:3.0:1785393669.708945:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284480 00000100:00100000:3.0:1785393669.708954:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284480 00000100:00100000:3.0:1785393669.708997:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284608 00000100:00100000:3.0:1785393669.709000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284608 00000100:00100000:3.0:1785393669.709018:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284736 00000100:00100000:3.0:1785393669.709021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284736 00000100:00100000:3.0:1785393669.709036:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785393669.709045:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5825:x1872120831284480:12345-0@lo:104: 00010000:00010000:3.0:1785393669.709060:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.709118:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785393669.709619:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5825:x1872120831284480:12345-0@lo:104: Request processed in 573us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393669.709646:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785393669.709665:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785393669.709672:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:5825:x1872120831284608:12345-0@lo:104: 00010000:00010000:3.0:1785393669.709680:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.709714:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785393669.709719:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:5825:x1872120831284608:12345-0@lo:104: Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393669.709725:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785393669.709734:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785393669.709739:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5825:x1872120831284736:12345-0@lo:104: 00010000:00010000:3.0:1785393669.709747:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.709790:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785393669.709795:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5825:x1872120831284736:12345-0@lo:104: Request processed in 56us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393669.709801:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1785393669.709818:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785393669.709825:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.709834:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cd000 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393669.709840:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710089:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393669.710098:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393669.710104:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393669.710356:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710383:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785393669.710424:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831284864:0@lo:103: 00000100:00100000:2.0:1785393669.710460:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393669.710544:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284864 00000100:00100000:0.0:1785393669.710550:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284864 00010000:00010000:0.0:1785393669.710587:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 13 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.710615:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785393669.710621:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3316:x1872120831284864:12345-0@lo:103: 00010000:00010000:0.0:1785393669.710630:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393669.710644:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 13 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.710668:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 13 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.710709:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393669.710763:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710785:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cd000/0xcc9b96d8b3629765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362976c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710803:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785393669.710806:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710815:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cc800 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393669.710818:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710825:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393669.710831:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393669.710841:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393669.710863:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710869:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393669.710891:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710912:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b36296f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710921:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393669.710924:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710929:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152a400 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393669.710932:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710938:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393669.710944:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393669.710948:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393669.710959:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710964:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393669.710975:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.710989:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36296d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36296e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711003:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393669.711005:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393669.711016:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393669.711023:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393669.711045:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831284992:0@lo:103: 00000100:00100000:3.0:1785393669.711070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393669.711091:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393669.711095:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831285120:0@lo:103: 00000100:00100000:3.0:1785393669.711113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393669.711148:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785393669.711155:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1785393669.711281:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831284992 00000100:00100000:3.0:1785393669.711285:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831284992 00010000:00010000:3.0:1785393669.711309:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 14 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393669.711324:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785393669.711328:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285120 00000100:00100000:3.0:1785393669.711331:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285120 00010000:00010000:3.0:1785393669.711338:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 15 pid: 5825 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393669.711348:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785393669.711353:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785393669.711358:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3317:x1872120831284992:12345-0@lo:103: 00010000:00010000:3.0:1785393669.711371:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393669.711376:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 15 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711386:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 15 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711396:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393669.711421:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3317:x1872120831284992:12345-0@lo:103: Request processed in 62us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393669.711426:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785393669.711437:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1785393669.711442:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785393669.711448:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3317:x1872120831285120:12345-0@lo:103: 00010000:00010000:3.0:1785393669.711454:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393669.711457:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 14 pid: 5825 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711466:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 14 pid: 5825 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711477:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711486:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711499:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711517:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711523:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711529:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711534:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393669.711539:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711561:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711589:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.711600:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393669.711621:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3317:x1872120831285120:12345-0@lo:103: Request processed in 173us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393669.711627:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785393669.711659:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831285120:0@lo:103: 00000100:00100000:3.0:1785393669.711666:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831284992:0@lo:103: 00000100:00100000:0.0:1785393669.719259:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3316:x1872120831284864:12345-0@lo:103: Request processed in 8621us (8780us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393669.719277:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785393669.723763:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831284864:0@lo:103: 00010000:00010000:0.0:1785393669.724230:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152a800/0xcc9b96d8b362976c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629765 expref: 12 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.724251:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284480:0@lo:104: 00010000:00010000:0.0:1785393669.724273:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc29cd400/0xcc9b96d8b36296fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36296f5 expref: 11 pid: 5826 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.724284:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284608:0@lo:104: 00010000:00010000:0.0:1785393669.724307:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36296e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36296d9 expref: 10 pid: 5825 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393669.724323:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831284736:0@lo:104: 00010000:00010000:0.0:1785393669.724356:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.724369:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.724375:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.724381:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785393669.724540:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1785393669.987932:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:6627:x1872120831284352:12345-0@lo:253: Request processed in 337577us (339055us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393669.987949:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785393669.991119:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831284352:0@lo:253: 10000000:01000000:3.0:1785393669.991281:0:6627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1785393669.991285:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785393669.991287:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785393669.991289:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393669.991290:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1785393669.991291:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393669.991293:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393669.991295:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785393669.991297:0:6627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1785393669.991299:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393669.991300:0:6627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1785393669.991432:0:6627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93acc825e800 from lustre-OST0000 10000000:01000000:2.0:1785393669.991465:0:6627:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1785393669.991470:0:6627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1785393669.991479:0:6627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93acc9538000 local copy 10000000:01000000:2.0:1785393669.991484:0:6627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785393669.991537:0:6627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393669.991549:0:6627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393669.991560:0:6627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393669.991601:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285248:0@lo:101: 00000100:00100000:2.0:1785393669.991738:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393669.991865:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285248 00000100:00100000:0.0:1785393669.991873:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285248 00000100:00100000:0.0:1785393669.991931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785393669.991942:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:6627:x1872120831285248:12345-0@lo:101: 00010000:00010000:0.0:1785393669.991958:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393669.991973:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36297ce expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.992021:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36297ce expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.992046:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297ce expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393669.992054:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031000, rc 0) 00000100:00100000:0.0:1785393669.992103:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:6627:x1872120831285248:12345-0@lo:101: Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393669.992108:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785393669.992487:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785393669.992517:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285248:0@lo:101: 00010000:00010000:2.0:1785393669.992532:0:6627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393669.992541:0:6627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393669.993885:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285376:0@lo:501: 00000100:00100000:2.0:1785393669.993931:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393669.993961:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785393669.994093:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285376 00000100:00100000:0.0:1785393669.994098:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285376 00000100:00100000:0.0:1785393669.994191:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785393669.994199:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:6627:x1872120831285376:12345-0@lo:501: 00000100:00100000:0.0:1785393669.994454:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:6627:x1872120831285376:12345-0@lo:501: Request processed in 255us (521us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785393669.994461:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785393669.995760:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285376:0@lo:501: 10000000:01000000:3.0:1785393669.995839:0:6627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1785393669.995903:0:6627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1785393669.995912:0:6627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.995924:0:6627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.995932:0:6627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.995963:0:6627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1785393669.995988:0:6627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93acc825e800 10000000:01000000:3.0:1785393669.995993:0:6627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1785393669.995999:0:6627:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93acc9538000 10000000:01000000:3.0:1785393669.996002:0:6627:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1785393669.996006:0:6627:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff93acc9538000 from 1 10000000:01000000:3.0:1785393669.996009:0:6627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1785393669.996042:0:6627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.996067:0:6627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393669.996079:0:6627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393669.996097:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285504:0@lo:101: 00010000:00010000:1.0:1785393669.996795:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393669.996805:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.996814:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cde00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785393669.996819:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.996829:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785393669.996837:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393669.996843:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1785393669.996896:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.996903:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785393669.996939:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.996948:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b36297ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36297d5 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.996967:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393669.996970:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393669.996972:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393669.996981:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393669.996994:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831285632:0@lo:103: 00000100:00100000:1.0:1785393669.998831:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393669.998914:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285632 00000100:00100000:1.0:1785393669.998923:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285632 00000100:00100000:1.0:1785393669.998988:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393669.998999:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:3316:x1872120831285632:12345-0@lo:103: 00010000:00010000:1.0:1785393669.999024:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393669.999042:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031000/0xcc9b96d8b36297d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36297ce expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393669.999063:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393669.999102:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:3316:x1872120831285632:12345-0@lo:103: Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393669.999109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393669.999281:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831285632:0@lo:103: 00000100:00100000:3.0:1785393670.005949:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393670.006778:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285504 00000100:00100000:0.0:1785393670.006807:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285504 00000100:00100000:0.0:1785393670.006873:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785393670.006883:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:6627:x1872120831285504:12345-0@lo:101: 00010000:00010000:0.0:1785393670.006906:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393670.006931:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36297e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36297dc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393670.006963:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36297e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36297dc expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393670.006974:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36297e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297dc expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393670.006985:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031200, rc 0) 00000100:00100000:0.0:1785393670.007048:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:6627:x1872120831285504:12345-0@lo:101: Request processed in 167us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.007055:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785393670.009373:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc2d7b540 going to sleep for 10 seconds 00000100:00100000:2.0:1785393670.009425:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285504:0@lo:101: 00010000:00010000:2.0:1785393670.009452:0:6627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.009466:0:6627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393670.009493:0:6627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1785393670.009504:0:6627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.009512:0:6627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393670.009521:0:6627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1785393670.009527:0:6627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785393670.009535:0:6627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1785393670.009537:0:6627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1785393670.009619:0:6627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.009627:0:6627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.009638:0:6627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393670.009660:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285760:0@lo:101: 00000100:00100000:2.0:1785393670.009734:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.009870:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:1.0:1785393670.009962:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285760 00000100:00100000:1.0:1785393670.009977:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285760 00000100:00100000:1.0:1785393670.010033:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785393670.010043:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+10:6627:x1872120831285760:12345-0@lo:101: 00010000:00010000:1.0:1785393670.010056:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393670.010071:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36297ea expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.010091:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.010101:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.010111:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42200, rc 0) 00000100:00100000:1.0:1785393670.010156:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831285760:12345-0@lo:101: Request processed in 114us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393670.010162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785393670.010421:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285760:0@lo:101: 00010000:00010000:2.0:1785393670.010432:0:6627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.010440:0:6627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393670.010592:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285888:0@lo:501: 00000100:00100000:2.0:1785393670.010618:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.010644:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.010705:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831285888 00000100:00100000:0.0:1785393670.010709:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831285888 00000100:00100000:0.0:1785393670.010740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785393670.010748:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831285888:12345-0@lo:501: 00000100:00100000:0.0:1785393670.011241:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831285888:12345-0@lo:501: Request processed in 492us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.011249:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785393670.011326:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831285888:0@lo:501: 00000100:00100000:2.0:1785393670.011354:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286016:0@lo:503: 00000100:00100000:2.0:1785393670.011395:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.011423:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.011660:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286016 00000100:00100000:0.0:1785393670.011665:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286016 00000100:00100000:0.0:1785393670.011759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785393670.011766:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286016:12345-0@lo:503: 00000100:00100000:0.0:1785393670.012501:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286016:12345-0@lo:503: Request processed in 734us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.012515:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1785393670.017559:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286016:0@lo:503: 00000040:00080000:2.0:1785393670.018220:0:6627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785393670.018340:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286144:0@lo:502: 00000100:00100000:2.0:1785393670.018428:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.018508:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.022013:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286144 00000100:00100000:0.0:1785393670.022031:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286144 00000100:00100000:0.0:1785393670.022103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785393670.022114:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286144:12345-0@lo:502: 00000100:00100000:0.0:1785393670.022438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286144:12345-0@lo:502: Request processed in 324us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.022446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785393670.022941:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286144:0@lo:502: 00000040:00080000:3.0:1785393670.023269:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785393670.023327:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1785393670.023363:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1785393670.023420:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1785393670.023465:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1785393670.023495:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1785393670.023553:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286272:0@lo:502: 00000100:00100000:3.0:1785393670.023650:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.023823:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc2d7b540 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.024199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286272 00000100:00100000:0.0:1785393670.024206:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286272 00000100:00100000:0.0:1785393670.024245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1785393670.024253:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286272:12345-0@lo:502: 00000100:00100000:0.0:1785393670.024422:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286272:12345-0@lo:502: Request processed in 168us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.024428:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785393670.025103:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286272:0@lo:502: 00000040:00080000:3.0:1785393670.025238:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1785393670.025252:0:6627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1785393670.027410:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785393670.027422:0:6647:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1785393670.027431:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393670.027433:0:6647:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1785393670.027438:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785393670.027456:0:6647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93acc95399c0) 00000020:00000080:3.0:1785393670.027479:0:6647:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1785393670.027490:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785393670.036986:0:6647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc825e800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1785393670.037027:0:6647:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785393670.037043:0:6647:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc9b96d8b36297ff 00010000:00010000:2.0:1785393670.057680:0:6647:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1785393670.058261:0:6647:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1785393670.077458:0:6647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1785393670.078509:0:6647:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1785393670.095073:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1785393670.096361:0:6647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1785393670.101067:0:6647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1785393670.101087:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393670.101094:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393670.101096:0:6647:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1785393670.101099:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785393670.101103:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393670.101104:0:6647:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785393670.101107:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785393670.101109:0:6647:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785393670.101155:0:6647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393670.101158:0:6647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393670.101159:0:6647:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785393670.101162:0:6647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1785393670.101276:0:6627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1785393670.101330:0:6627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1785393670.101357:0:6627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.101373:0:6627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393670.101383:0:6627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc825e800 from 1 10000000:01000000:2.0:1785393670.101387:0:6627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785393670.101437:0:6627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.101446:0:6627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.101477:0:6627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393670.101506:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286400:0@lo:101: 00000100:00100000:2.0:1785393670.101934:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.102036:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:1.0:1785393670.102756:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286400 00000100:00100000:1.0:1785393670.102766:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286400 00000100:00100000:1.0:1785393670.102809:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785393670.102819:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:6627:x1872120831286400:12345-0@lo:101: 00010000:00010000:1.0:1785393670.102900:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393670.102917:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629806 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.102942:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.102953:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.102982:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43000, rc 0) 00000100:00100000:1.0:1785393670.103053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286400:12345-0@lo:101: Request processed in 236us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393670.103060:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785393670.105040:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286400:0@lo:101: 00010000:00010000:3.0:1785393670.105064:0:6627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.105086:0:6627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393670.105197:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286528:0@lo:501: 00000100:00100000:3.0:1785393670.105240:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.105280:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8240 going to sleep for 11 seconds 00000100:00100000:1.0:1785393670.105382:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286528 00000100:00100000:1.0:1785393670.105387:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286528 00000100:00100000:1.0:1785393670.105421:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785393670.105428:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286528:12345-0@lo:501: 00000100:00100000:1.0:1785393670.106463:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286528:12345-0@lo:501: Request processed in 1033us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393670.106472:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785393670.106951:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286528:0@lo:501: 00000100:00100000:3.0:1785393670.106985:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286656:0@lo:503: 00000100:00100000:3.0:1785393670.107021:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.107045:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8240 going to sleep for 11 seconds 00000100:00100000:1.0:1785393670.107145:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286656 00000100:00100000:1.0:1785393670.107150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286656 00000100:00100000:1.0:1785393670.108977:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785393670.108994:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286656:12345-0@lo:503: 00000100:00100000:1.0:1785393670.109292:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286656:12345-0@lo:503: Request processed in 304us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393670.109300:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785393670.113249:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286656:0@lo:503: 00000040:00080000:3.0:1785393670.113532:0:6627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785393670.113624:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286784:0@lo:502: 00000100:00100000:3.0:1785393670.113706:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.113755:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8240 going to sleep for 11 seconds 00000100:00100000:3.0:1785393670.113772:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286784 00000100:00100000:3.0:1785393670.113777:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286784 00000100:00100000:3.0:1785393670.113804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785393670.113811:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286784:12345-0@lo:502: 00000100:00100000:3.0:1785393670.114058:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286784:12345-0@lo:502: Request processed in 246us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393670.114065:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785393670.114129:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286784:0@lo:502: 00000040:00080000:3.0:1785393670.114340:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1785393670.114380:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1785393670.114398:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286912:0@lo:502: 00000100:00100000:3.0:1785393670.114427:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.114438:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8240 going to sleep for 11 seconds 00000100:00100000:3.0:1785393670.114451:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831286912 00000100:00100000:3.0:1785393670.114454:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831286912 00000100:00100000:3.0:1785393670.114470:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785393670.114476:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286912:12345-0@lo:502: 00000100:00100000:3.0:1785393670.114597:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831286912:12345-0@lo:502: Request processed in 120us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393670.114604:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785393670.114639:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831286912:0@lo:502: 00000040:00080000:3.0:1785393670.114711:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1785393670.114721:0:6627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1785393670.127838:0:6651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393670.127860:0:6651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393670.127863:0:6651:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785393670.127869:0:6651:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc825e800 00000020:00000080:0.0:1785393670.127871:0:6651:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785393670.127894:0:6651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393670.127896:0:6651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393670.127898:0:6651:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1785393670.127901:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1785393670.128224:0:6627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1785393670.128245:0:6627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785393670.128266:0:6627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.128276:0:6627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393670.128311:0:6627:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785393670.128314:0:6627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93acc825e800 10000000:01000000:3.0:1785393670.128317:0:6627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93acc825e800 10000000:01000000:3.0:1785393670.128320:0:6627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785393670.128325:0:6627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc825e800 from 1 10000000:01000000:3.0:1785393670.128327:0:6627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785393670.128357:0:6627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.128364:0:6627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.128372:0:6627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393670.128390:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287040:0@lo:101: 00000100:00100000:3.0:1785393670.128446:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.128487:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393670.128556:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287040 00000100:00100000:2.0:1785393670.128563:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287040 00000100:00100000:2.0:1785393670.128625:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785393670.128634:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831287040:12345-0@lo:101: 00010000:00010000:2.0:1785393670.128646:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393670.128657:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629814 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.128875:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.128885:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393670.128893:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc29cd000, rc 0) 00000100:00100000:2.0:1785393670.128965:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287040:12345-0@lo:101: Request processed in 333us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.128971:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785393670.129069:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287040:0@lo:101: 00010000:00010000:3.0:1785393670.129090:0:6627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.129105:0:6627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393670.129177:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287168:0@lo:501: 00000100:00100000:3.0:1785393670.129198:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.129222:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393670.129305:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287168 00000100:00100000:2.0:1785393670.129309:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287168 00000100:00100000:2.0:1785393670.129331:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785393670.129336:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287168:12345-0@lo:501: 00000100:00100000:2.0:1785393670.129520:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287168:12345-0@lo:501: Request processed in 183us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.129526:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785393670.129554:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287168:0@lo:501: 00000100:00100000:2.0:1785393670.129603:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287296:0@lo:503: 00000100:00100000:2.0:1785393670.129644:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.129655:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393670.129666:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287296 00000100:00100000:2.0:1785393670.130295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287296 00000100:00100000:2.0:1785393670.130322:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785393670.130328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287296:12345-0@lo:503: 00000100:00100000:2.0:1785393670.130462:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287296:12345-0@lo:503: Request processed in 133us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.130469:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785393670.130510:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287296:0@lo:503: 00000040:00080000:2.0:1785393670.131975:0:6627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785393670.132044:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287424:0@lo:502: 00000100:00100000:2.0:1785393670.132436:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.132467:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393670.132489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287424 00000100:00100000:2.0:1785393670.132495:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287424 00000100:00100000:2.0:1785393670.132520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785393670.132527:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287424:12345-0@lo:502: 00000100:00100000:2.0:1785393670.132775:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287424:12345-0@lo:502: Request processed in 248us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.132782:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785393670.132822:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287424:0@lo:502: 00000040:00080000:2.0:1785393670.133055:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1785393670.133273:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1785393670.133303:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1785393670.133342:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1785393670.133371:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1785393670.133429:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1785393670.133461:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1785393670.133494:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1785393670.133557:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1785393670.133883:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1785393670.133924:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1785393670.133968:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1785393670.133997:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1785393670.134025:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1785393670.134064:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1785393670.134531:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1785393670.134564:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1785393670.135397:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1785393670.135435:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1785393670.135469:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1785393670.135518:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1785393670.135565:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1785393670.135680:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1785393670.135734:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1785393670.135766:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1785393670.135794:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1785393670.135833:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1785393670.135875:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1785393670.135916:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287552:0@lo:502: 00000100:00100000:0.0:1785393670.135976:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393670.136009:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101540 going to sleep for 11 seconds 00000100:00100000:2.0:1785393670.136603:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287552 00000100:00100000:2.0:1785393670.136610:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287552 00000100:00100000:2.0:1785393670.136649:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785393670.136656:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287552:12345-0@lo:502: 00000100:00100000:2.0:1785393670.136973:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287552:12345-0@lo:502: Request processed in 317us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.136980:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785393670.138197:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287552:0@lo:502: 00000040:00080000:0.0:1785393670.138292:0:6627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1785393670.138305:0:6627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1785393670.145424:0:6652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1785393670.145440:0:6652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93acc7ad3380) 00000020:00000080:2.0:1785393670.145460:0:6652:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1785393670.145647:0:6652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc825e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1785393670.145651:0:6652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acc825e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1785393670.145654:0:6652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc825e800 3 00010000:00080000:2.0:1785393670.145678:0:6652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acf724c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785393670.156642:0:6652:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1785393670.156753:0:6652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1785393670.156790:0:6652:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785393670.156800:0:6652:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcc9b96d8b3629829 00000100:00080000:3.0:1785393670.156808:0:6652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785393670.156814:0:6652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93acf724c800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785393670.156843:0:6652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad00213100 x1872120831287680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785393670.156875:0:6652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1785393670.158294:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831287680:0@lo:38: 00000100:00100000:2.0:1785393670.158358:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1785393670.158941:0:6652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1785393670.159500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287680 00000100:00100000:3.0:1785393670.159508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287680 00000100:00100000:3.0:1785393670.159542:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785393670.159549:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831287680:12345-0@lo:38: 00010000:00080000:3.0:1785393670.159599:0:5831:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1785393670.159629:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc9b96d8b3629830 00000004:00100000:3.0:1785393670.159642:0:5831:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1785393670.159667:0:5831:0:(import.c:65:import_set_state_nolock()) ffff93acffb35000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785393670.159827:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872120831287680:12345-0@lo:38: Request processed in 278us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393670.159833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1785393670.159912:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ad00213100 x1872120831287680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785393680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393670.159926:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785393670.159933:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1785393670.159939:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1785393670.159943:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785393670.159945:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf724c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785393670.159950:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831287680:0@lo:38: 00000020:01000000:0.0:1785393670.160347:0:6627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1785393670.160372:0:6627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785393670.160383:0:6627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393670.160392:0:6627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1785393670.160429:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1785393670.160431:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785393670.160433:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785393670.160434:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785393670.160435:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785393670.160436:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785393670.160437:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785393670.160439:0:6627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785393670.160440:0:6627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785393670.160442:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785393670.160443:0:6627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785393670.160447:0:6627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1785393670.160449:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785393670.160455:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785393670.160456:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785393670.160457:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785393670.160458:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785393670.160459:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785393670.160460:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785393670.160461:0:6627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785393670.160462:0:6627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785393670.160463:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785393670.160464:0:6627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785393670.160478:0:6627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1785393670.160489:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287936:0@lo:253: 00000100:00100000:0.0:1785393670.160523:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393670.160546:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101540 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.160591:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287936 00000100:00100000:0.0:1785393670.160595:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287936 00000100:00100000:0.0:1785393670.160624:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785393670.160630:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6627:x1872120831287936:12345-0@lo:253: 20000000:01000000:0.0:1785393670.160659:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1785393670.160766:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393670.160774:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831287808:0@lo:400: 00000100:00100000:2.0:1785393670.160800:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393670.160824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831287808 00000100:00100000:2.0:1785393670.160827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831287808 00000100:00100000:2.0:1785393670.160861:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785393670.160867:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831287808:12345-0@lo:400: 00000100:00100000:2.0:1785393670.160898:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831287808:12345-0@lo:400: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.160904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1785393670.160925:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acf75a5880 x1872120831287808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393670.160935:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831287808:0@lo:400: 20000000:01000000:0.0:1785393670.161029:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1785393670.223645:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785393670.223685:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1785393670.223808:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785393670.223814:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785393670.223860:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.223888:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.223906:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.223999:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.224017:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 13 pid: 5824 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393670.224035:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831288064:0@lo:104: 00000100:00100000:1.0:1785393670.224112:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393670.224183:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8711180 going to sleep for 11 seconds 00000100:00100000:0.0:1785393670.225565:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288064 00000100:00100000:0.0:1785393670.225605:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288064 00000100:00100000:0.0:1785393670.225684:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785393670.225694:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831288064:12345-0@lo:104: 00010000:00010000:0.0:1785393670.225715:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393670.225822:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785393670.225840:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831288064:12345-0@lo:104: Request processed in 136us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393670.225858:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785393670.225993:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831288064:0@lo:104: 00010000:00010000:1.0:1785393670.226033:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227215:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393670.227227:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227238:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cce00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393670.227241:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227250:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393670.227256:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393670.227262:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393670.227324:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227330:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393670.227360:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227366:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362978f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629796 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.227388:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393670.227391:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393670.227395:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393670.227427:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393670.227455:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831288192:0@lo:103: 00000100:00100000:2.0:1785393670.227747:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393670.228010:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288192 00000100:00100000:3.0:1785393670.228020:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288192 00010000:00010000:3.0:1785393670.228053:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 14 pid: 5824 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393670.232380:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785393670.232398:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3318:x1872120831288192:12345-0@lo:103: 00010000:00010000:3.0:1785393670.232413:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393670.232420:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 14 pid: 5824 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232432:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 14 pid: 5824 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232449:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0030600/0xcc9b96d8b3629796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362978f expref: 14 pid: 5824 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232468:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232476:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785393670.232493:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008679578s 00010000:00010000:3.0:1785393670.232497:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232503:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232509:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232516:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232534:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393670.232538:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232545:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232563:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232588:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393670.232656:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3318:x1872120831288192:12345-0@lo:103: Request processed in 267us (4909us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393670.232662:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785393670.232753:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831288192:0@lo:103: 00010000:00010000:3.0:1785393670.232780:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232787:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393670.232793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42600/0xcc9b96d8b3629837 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393670.257697:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393670.309705:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:6627:x1872120831287936:12345-0@lo:253: Request processed in 149062us (149168us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393670.309740:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785393670.312613:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6627:1872120831287936:0@lo:253: 10000000:01000000:0.0:1785393670.312657:0:6627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1785393670.312661:0:6627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785393670.312663:0:6627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785393670.312665:0:6627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785393670.312666:0:6627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785393670.312667:0:6627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785393670.312669:0:6627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785393670.312670:0:6627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785393670.312672:0:6627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785393670.312674:0:6627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785393670.312675:0:6627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785393670.312676:0:6627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1785393670.312695:0:6627:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785393670.331372:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393670.333208:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785393670.334783:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393670.336248:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785393670.337368:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1785393670.353532:0:6627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1785393670.371071:0:6627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1785393670.780957:0:6627:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1785393670.780979:0:6627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1785393670.781014:0:6627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785393670.781079:0:6627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785393670.781094:0:6627:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1785393670.781120:0:6627:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:0.0:1785393671.137909:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785393671.137915:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ace0136800 from 21 10000000:01000000:0.0:1785393671.137920:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785393671.137959:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.137970:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.137979:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393671.137998:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288320:0@lo:101: 00000100:00100000:0.0:1785393671.138052:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393671.138098:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc11010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.149609:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288320 00000100:00100000:2.0:1785393671.149622:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288320 00000100:00100000:2.0:1785393671.149695:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785393671.149706:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831288320:12345-0@lo:101: 00010000:00010000:2.0:1785393671.149723:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393671.149741:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362983e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.149770:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.149781:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.149789:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc29cd600, rc 0) 00000100:00100000:2.0:1785393671.149868:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288320:12345-0@lo:101: Request processed in 165us (11815us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.149874:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1785393671.149899:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288320:0@lo:101: 00010000:00010000:0.0:1785393671.149917:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.149925:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393671.149988:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288448:0@lo:501: 00000100:00100000:0.0:1785393671.150021:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.150047:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288448 00000100:00100000:2.0:1785393671.150051:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288448 00000100:00100000:0.0:1785393671.150060:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc11010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.150073:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785393671.150079:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288448:12345-0@lo:501: 00000100:00100000:2.0:1785393671.150320:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288448:12345-0@lo:501: Request processed in 240us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.150328:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785393671.150342:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288448:0@lo:501: 00000100:00100000:0.0:1785393671.150371:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288576:0@lo:503: 00000100:00100000:0.0:1785393671.150405:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.150424:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288576 00000100:00100000:0.0:1785393671.150425:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc11010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.150428:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288576 00000100:00100000:2.0:1785393671.150469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785393671.150476:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288576:12345-0@lo:503: 00000100:00100000:2.0:1785393671.150635:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288576:12345-0@lo:503: Request processed in 159us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.150641:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785393671.150702:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288576:0@lo:503: 00000100:00100000:0.0:1785393671.150889:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6668:1872120831288704:0@lo:502: 00000100:00100000:0.0:1785393671.150919:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.150936:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288704 00000100:00100000:0.0:1785393671.150936:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101240 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.150940:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288704 00000100:00100000:2.0:1785393671.150971:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785393671.150977:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6668:x1872120831288704:12345-0@lo:502: 00000100:00100000:2.0:1785393671.151123:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6668:x1872120831288704:12345-0@lo:502: Request processed in 145us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.151129:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785393671.151143:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6668:1872120831288704:0@lo:502: 00000100:00100000:0.0:1785393671.151178:0:6668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6668:1872120831288832:0@lo:502: 00000100:00100000:0.0:1785393671.151206:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.151222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288832 00000100:00100000:0.0:1785393671.151224:0:6668:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101240 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.151226:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288832 00000100:00100000:2.0:1785393671.151258:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785393671.151265:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6668:x1872120831288832:12345-0@lo:502: 00000100:00100000:2.0:1785393671.151388:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:6668:x1872120831288832:12345-0@lo:502: Request processed in 124us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.151394:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1785393671.151407:0:6668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6668:1872120831288832:0@lo:502: 00000040:00080000:0.0:1785393671.151424:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1785393671.151470:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1785393671.151490:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785393671.151497:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.151505:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393671.151514:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785393671.151517:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ace0136800 from 4 10000000:01000000:0.0:1785393671.151520:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785393671.151552:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.151559:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.151582:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393671.151603:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288960:0@lo:101: 00000100:00100000:0.0:1785393671.151625:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.151641:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831288960 00000100:00100000:0.0:1785393671.151642:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101240 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.151646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831288960 00000100:00100000:2.0:1785393671.151666:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785393671.151678:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831288960:12345-0@lo:101: 00010000:00010000:2.0:1785393671.151685:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393671.151694:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362984c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.151707:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.151716:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.151723:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc29cc200, rc 0) 00000100:00100000:2.0:1785393671.151759:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831288960:12345-0@lo:101: Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.151765:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785393671.151790:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831288960:0@lo:101: 00010000:00010000:0.0:1785393671.151800:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.151808:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393671.151854:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289088:0@lo:256: 00000100:00100000:0.0:1785393671.151898:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.151915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289088 00000100:00100000:0.0:1785393671.151916:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101240 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.151919:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289088 00000100:00100000:2.0:1785393671.151949:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785393671.151956:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831289088:12345-0@lo:256: 20000000:01000000:2.0:1785393671.151967:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785393671.151982:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785393671.151985:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1785393671.152052:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831289088:12345-0@lo:256: Request processed in 96us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.152058:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785393671.152087:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289088:0@lo:256: 10000000:01000000:2.0:1785393671.152121:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785393671.152126:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.152138:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393671.152145:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1785393671.152147:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1785393671.152149:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785393671.152163:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.152170:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.152178:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393671.152189:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289216:0@lo:101: 00000100:00100000:2.0:1785393671.152212:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.152231:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:0.0:1785393671.152329:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289216 00000100:00100000:0.0:1785393671.152333:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289216 00000100:00100000:0.0:1785393671.152358:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785393671.152364:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831289216:12345-0@lo:101: 00010000:00010000:0.0:1785393671.152371:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393671.152378:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362985a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.152391:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.152399:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393671.152405:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0030200, rc 0) 00000100:00100000:0.0:1785393671.152447:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831289216:12345-0@lo:101: Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.152451:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289216:0@lo:101: 00000100:00100000:0.0:1785393671.152453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1785393671.152461:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.152468:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393671.152503:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289344:0@lo:501: 00000100:00100000:2.0:1785393671.152527:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.152553:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:0.0:1785393671.152816:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289344 00000100:00100000:0.0:1785393671.152821:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289344 00000100:00100000:0.0:1785393671.152855:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1785393671.152862:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831289344:12345-0@lo:501: 00000100:00100000:0.0:1785393671.153088:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831289344:12345-0@lo:501: Request processed in 226us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393671.153095:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785393671.157879:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289344:0@lo:501: 00000100:00100000:2.0:1785393671.157932:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289472:0@lo:503: 00000100:00100000:2.0:1785393671.157994:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.158038:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393671.166253:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289472 00000100:00100000:1.0:1785393671.166268:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289472 00000100:00100000:1.0:1785393671.166338:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785393671.166349:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831289472:12345-0@lo:503: 00000100:00100000:1.0:1785393671.166691:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831289472:12345-0@lo:503: Request processed in 344us (8696us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393671.166699:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785393671.168204:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831289472:0@lo:503: 00000100:00100000:1.0:1785393671.181880:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6670:1872120831289600:0@lo:502: 00000100:00100000:1.0:1785393671.181963:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393671.182013:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.182106:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289600 00000100:00100000:2.0:1785393671.182114:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289600 00000100:00100000:2.0:1785393671.182159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785393671.182169:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:6670:x1872120831289600:12345-0@lo:502: 00000100:00100000:1.0:1785393671.182683:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6670:1872120831289600:0@lo:502: 00000020:01000000:1.0:1785393671.182720:0:6670:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785393671.182727:0:6670:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785393671.182734:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393671.182736:0:6670:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1785393671.182742:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785393671.182745:0:6670:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1785393671.192390:0:6670:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785393671.192402:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785393671.192431:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93acce5d19c0) 00000020:00000080:1.0:1785393671.192470:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1785393671.192480:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785393671.192593:0:6670:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1785393671.192599:0:6670:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1785393671.192606:0:6670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362986f 00010000:00080000:1.0:1785393671.192635:0:6670:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acc88ff800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1785393671.192886:0:6670:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000100:00100000:2.0:1785393671.198039:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:6670:x1872120831289600:12345-0@lo:502: Request processed in 15864us (16069us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.198050:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1785393671.265769:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1785393671.268223:0:6670:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1785393671.268239:0:6670:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785393671.269291:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785393671.270832:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785393671.270903:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1785393671.270969:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1785393671.275969:0:6673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393671.275975:0:6673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1785393671.279189:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785393671.279201:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1785393671.279231:0:6670:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1785393671.279248:0:6670:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b3629876 00000100:00080000:1.0:1785393671.279257:0:6670:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785393671.279262:0:6670:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93acc88ff800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785393671.279302:0:6670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad008f5180 x1872120831289728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785393671.279364:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831289728:0@lo:8: 00000100:00100000:0.0:1785393671.279435:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785393671.279503:0:6670:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1785393671.279556:0:6670:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393671.279561:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393671.279563:0:6670:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1785393671.279566:0:6670:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785393671.279587:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393671.279589:0:6670:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785393671.279592:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785393671.279594:0:6670:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1785393671.279618:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6670:1872120831289856:0@lo:502: 00000100:00100000:1.0:1785393671.279661:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.279746:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289728 00000100:00100000:2.0:1785393671.279753:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289728 00000100:00100000:2.0:1785393671.279779:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785393671.279785:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1872120831289728:12345-0@lo:8: 00010000:00080000:2.0:1785393671.279806:0:6630:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1785393671.279825:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362987d 00002000:00100000:2.0:1785393671.279861:0:6630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93acf724e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1785393671.279865:0:6630:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1785393671.279868:0:6630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1785393671.279970:0:6630:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1785393671.280078:0:6630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785393671.280097:0:6630:0:(import.c:65:import_set_state_nolock()) ffff93acf724a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785393671.280956:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e540 going to sleep for 11 seconds 00000100:00100000:3.0:1785393671.283369:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289856 00000100:00100000:3.0:1785393671.283377:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289856 00000100:00100000:3.0:1785393671.283670:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785393671.283681:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:6670:x1872120831289856:12345-0@lo:502: 00000100:00100000:3.0:1785393671.285052:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:6670:x1872120831289856:12345-0@lo:502: Request processed in 1371us (5387us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393671.285061:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785393671.285140:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:6670:1872120831289856:0@lo:502: 00000020:01000000:1.0:1785393671.285170:0:6670:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393671.285176:0:6670:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393671.285178:0:6670:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1785393671.285181:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1785393671.285686:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393671.285698:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831289984:0@lo:400: 00000100:00100000:1.0:1785393671.285741:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393671.285774:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393671.285780:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831290112:0@lo:400: 00000100:00100000:1.0:1785393671.285803:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393671.285828:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831289984 00000100:00100000:1.0:1785393671.285832:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831289984 00000100:00100000:1.0:1785393671.285867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290112 00000100:00100000:1.0:1785393671.285870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290112 00000100:00100000:1.0:1785393671.285899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785393671.285905:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831289984:12345-0@lo:400: 00000100:00100000:1.0:1785393671.285940:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831289984:12345-0@lo:400: Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393671.285945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785393671.285956:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785393671.285960:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831290112:12345-0@lo:400: 00000100:00100000:1.0:1785393671.285983:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831290112:12345-0@lo:400: Request processed in 23us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393671.285988:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1785393671.286009:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4700 x1872120831290112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393671.286018:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831290112:0@lo:400: 00010000:00080000:1.0:1785393671.286034:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f6a00 x1872120831289984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393671.286042:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831289984:0@lo:400: 00000100:00080000:3.0:1785393671.286349:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393671.287510:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872120831289728:12345-0@lo:8: Request processed in 7721us (8072us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.287526:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1785393671.287594:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1785393671.287614:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1785393671.287623:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.287634:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393671.287643:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1785393671.287646:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93acc9538000 from 1 10000000:01000000:2.0:1785393671.287649:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785393671.287675:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.287682:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.287691:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393671.287705:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831290240:0@lo:101: 00000100:00100000:2.0:1785393671.288956:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.288984:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.289252:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290240 00000100:00100000:2.0:1785393671.289258:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290240 00000100:00100000:2.0:1785393671.289293:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785393671.289300:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831290240:12345-0@lo:101: 00010000:00010000:2.0:1785393671.289311:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393671.289340:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629884 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.289364:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.289375:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.289384:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393671.289414:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831290240:12345-0@lo:101: Request processed in 114us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.289419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785393671.289593:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831290240:0@lo:101: 00010000:00010000:2.0:1785393671.289607:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.289616:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393671.289664:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831290368:0@lo:501: 00000100:00100000:2.0:1785393671.291823:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.291872:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.292624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290368 00000100:00100000:2.0:1785393671.292631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290368 00000100:00100000:2.0:1785393671.292667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785393671.292675:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831290368:12345-0@lo:501: 00000100:00100000:2.0:1785393671.294031:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831290368:12345-0@lo:501: Request processed in 1354us (2208us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785393671.294048:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785393671.294101:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831290368:0@lo:501: 10000000:01000000:2.0:1785393671.294130:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1785393671.294139:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393671.294148:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1785393671.295402:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f5180 x1872120831289728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785393681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393671.295413:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785393671.295419:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1785393671.295426:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1785393671.295431:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1785393671.295434:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc88ff800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1785393671.295448:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1785393671.295454:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831289728:0@lo:8: 00000004:00080000:0.0:1785393671.295491:0:6673:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785393671.295623:0:6673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203327052618ns, next at 0ns, rc = 0 00000004:00080000:3.0:1785393671.347604:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1785393671.348869:0:6674:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785393671.348894:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290624:0@lo:7: 00000100:00100000:0.0:1785393671.348949:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393671.348990:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290624 00000100:00100000:0.0:1785393671.348995:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290624 00000100:00100000:0.0:1785393671.349040:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785393671.349047:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6674:x1872120831290624:12345-0@lo:7: 00000100:00100000:3.0:1785393671.349871:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393671.349885:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831290496:0@lo:13: 00000100:00100000:3.0:1785393671.349921:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393671.349971:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290496 00000100:00100000:3.0:1785393671.349975:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290496 00000100:00100000:3.0:1785393671.349998:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785393671.350004:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872120831290496:12345-0@lo:13: 00002000:00000024:3.0:1785393671.350016:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1785393671.350050:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1872120831290496:12345-0@lo:13: Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393671.350055:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785393671.350086:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a4000 x1872120831290496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393671.350102:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831290496:0@lo:13: 00000100:00080000:2.0:1785393671.351932:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393671.357611:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101000 going to sleep for 11 seconds 00002000:00080000:0.0:1785393671.361632:0:6632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1785393671.361640:0:6632:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1785393671.364751:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6674:x1872120831290624:12345-0@lo:7: Request processed in 15697us (15794us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393671.364765:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785393671.369962:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a4e00 x1872120831290624/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785393687 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393671.369980:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290624:0@lo:7: 00000004:00080000:3.0:1785393671.369994:0:6674:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1785393671.370032:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290752:0@lo:5: 00000100:00100000:3.0:1785393671.370079:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393671.371812:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393671.374903:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290752 00000100:00100000:0.0:1785393671.374913:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290752 00000100:00100000:1.0:1785393671.375026:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785393671.375035:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6674:x1872120831290752:12345-0@lo:5: 00002000:00080000:1.0:1785393671.375062:0:6630:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1785393671.375065:0:6630:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1785393671.375383:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6674:x1872120831290752:12345-0@lo:5: Request processed in 348us (5302us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1785393671.375390:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1785393671.375491:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00212d80 x1872120831290752/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785393687 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393671.375518:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290752:0@lo:5: 00000004:00080000:0.0:1785393671.375530:0:6674:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785393671.375564:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290880:0@lo:700: 00000100:00100000:0.0:1785393671.375632:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393671.375665:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc1101e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785393671.375819:0:6638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831290880 00000100:00100000:2.0:1785393671.375824:0:6638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831290880 00000100:00100000:2.0:1785393671.375854:0:6638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785393671.375861:0:6638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6674:x1872120831290880:12345-0@lo:700: 00000100:00100000:2.0:1785393671.375886:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6638:1872120831291008:0@lo:700: 00000100:00100000:2.0:1785393671.375914:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393671.375929:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93600 going to sleep for 11 seconds 00000100:00100000:1.0:1785393671.376001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291008 00000100:00100000:1.0:1785393671.376004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291008 00000100:00100000:1.0:1785393671.376028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785393671.376038:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6638:x1872120831291008:12345-0@lo:700: 40000000:02000000:2.0:1785393671.432238:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1785393671.453683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6638:x1872120831291008:12345-0@lo:700: Request processed in 77637us (77761us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393671.453701:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1785393671.453963:0:6638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acc7aca680 x1872120831291008/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785393687 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393671.453977:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6638:1872120831291008:0@lo:700: 40000000:02000000:2.0:1785393671.453988:0:6638:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1785393671.571648:0:6638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6674:x1872120831290880:12345-0@lo:700: Request processed in 195782us (196010us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393671.571661:0:6638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1785393671.571761:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1785393671.571773:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1785393671.571814:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a6680 x1872120831290880/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785393687 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393671.571831:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831290880:0@lo:700: 00000004:02000040:3.0:1785393671.637649:0:6674:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1785393671.651907:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831291136:0@lo:5: 00000100:00100000:3.0:1785393671.651966:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393671.652007:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291136 00000100:00100000:3.0:1785393671.652013:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291136 00000100:00100000:3.0:1785393671.652057:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785393671.652066:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6674:x1872120831291136:12345-0@lo:5: 00002000:00080000:3.0:1785393671.671967:0:6632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1785393671.671984:0:6632:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1785393671.679788:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8240 going to sleep for 11 seconds 00000100:00100000:3.0:1785393671.680389:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6674:x1872120831291136:12345-0@lo:5: Request processed in 28320us (28417us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785393671.680399:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1785393671.682386:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00213480 x1872120831291136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785393687 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393671.682400:0:6674:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1785393671.682415:0:6674:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93ad00213480 x1872120831291136/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785393687 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393671.682426:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6674:1872120831291136:0@lo:5: 00000004:00080000:2.0:1785393671.682439:0:6674:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1785393672.287796:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393673.311769:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393674.335808:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393675.360736:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393676.320134:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831291392:0@lo:400: 00000100:00100000:0.0:1785393676.320194:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393676.320243:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393676.320319:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831291648:0@lo:400: 00000100:00100000:2.0:1785393676.320350:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393676.320385:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393676.320392:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831291520:0@lo:400: 00000100:00100000:2.0:1785393676.320413:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393676.320438:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291648 00000100:00100000:2.0:1785393676.320443:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291648 00000100:00100000:2.0:1785393676.320491:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785393676.320500:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831291648:12345-0@lo:400: 00000100:00100000:2.0:1785393676.320545:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831291648:12345-0@lo:400: Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393676.320551:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785393676.320737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291392 00000100:00100000:2.0:1785393676.320745:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291392 00000100:00100000:2.0:1785393676.320767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291520 00000100:00100000:2.0:1785393676.320770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291520 00000100:00100000:2.0:1785393676.320783:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785393676.320788:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831291392:12345-0@lo:400: 00000100:00100000:2.0:1785393676.320830:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831291392:12345-0@lo:400: Request processed in 42us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393676.320837:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785393676.320847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785393676.320853:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831291520:12345-0@lo:400: 00000100:00100000:2.0:1785393676.320875:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831291520:12345-0@lo:400: Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393676.320880:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1785393676.320893:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393676.320896:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785393676.320918:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a5500 x1872120831291520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393676.320929:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831291520:0@lo:400: 00010000:00080000:2.0:1785393676.320938:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a6680 x1872120831291648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393676.320946:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831291648:0@lo:400: 00000100:00100000:0.0:1785393676.321105:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831291264:0@lo:400: 00000100:00100000:0.0:1785393676.321133:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1785393676.321169:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf75a4380 x1872120831291392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393676.321177:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831291392:0@lo:400: 00000100:00100000:2.0:1785393676.324063:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291264 00000100:00100000:2.0:1785393676.324072:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291264 00000100:00100000:2.0:1785393676.324110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785393676.324118:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3318:x1872120831291264:12345-0@lo:400: 00000100:00100000:2.0:1785393676.324180:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3318:x1872120831291264:12345-0@lo:400: Request processed in 62us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393676.324193:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785393676.324243:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831291264:0@lo:400: 00010000:00010000:0.0:1785393676.383720:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393676.840436:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393676.840457:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831291776:0@lo:13: 00000100:00100000:2.0:1785393676.840518:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393676.840610:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291776 00000100:00100000:2.0:1785393676.840618:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291776 00000100:00100000:2.0:1785393676.840661:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785393676.840670:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831291776:12345-0@lo:13: 00002000:00000024:2.0:1785393676.840705:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393676.840750:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831291776:12345-0@lo:13: Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393676.840756:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785393676.840789:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acc7ac9c00 x1872120831291776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393676.840816:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831291776:0@lo:13: 00000001:00080000:0.0:1785393676.951839:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1785393677.407842:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393678.431968:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393679.461174:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785393679.905919:0:7000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1785393680.482102:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393681.439801:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831292160:0@lo:400: 00000100:00100000:2.0:1785393681.439863:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393681.439913:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393681.439919:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831292032:0@lo:400: 00000100:00100000:2.0:1785393681.439939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393681.439964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292160 00000100:00100000:2.0:1785393681.439971:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292160 00000100:00100000:2.0:1785393681.440016:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292032 00000100:00100000:2.0:1785393681.440024:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292032 00000100:00100000:2.0:1785393681.440042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785393681.440049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831292160:12345-0@lo:400: 00000100:00100000:2.0:1785393681.440096:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831292160:12345-0@lo:400: Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393681.440103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785393681.440118:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785393681.440123:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831292032:12345-0@lo:400: 00000100:00100000:2.0:1785393681.440147:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831292032:12345-0@lo:400: Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393681.440153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1785393681.440170:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785393681.440194:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acc7aca300 x1872120831292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393681.440209:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831292032:0@lo:400: 00010000:00080000:2.0:1785393681.440233:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acc7acaa00 x1872120831292160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393681.440242:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831292160:0@lo:400: 00000100:00100000:0.0:1785393681.440343:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831291904:0@lo:400: 00000100:00100000:0.0:1785393681.440376:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393681.440410:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393681.440423:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831292288:0@lo:400: 00000100:00100000:0.0:1785393681.440449:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393681.440480:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292288 00000100:00100000:0.0:1785393681.440483:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292288 00000100:00100000:0.0:1785393681.440511:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785393681.440516:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831292288:12345-0@lo:400: 00000100:00100000:0.0:1785393681.440547:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831292288:12345-0@lo:400: Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393681.440552:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1785393681.440566:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785393681.440602:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acc7ac9180 x1872120831292288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393681.440611:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1785393681.440622:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831292288:0@lo:400: 00000100:00100000:2.0:1785393681.440679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831291904 00000100:00100000:2.0:1785393681.440683:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831291904 00000100:00100000:2.0:1785393681.440713:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785393681.440719:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3318:x1872120831291904:12345-0@lo:400: 00000100:00100000:2.0:1785393681.440748:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3318:x1872120831291904:12345-0@lo:400: Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393681.440753:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785393681.440815:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831291904:0@lo:400: 00010000:00010000:1.0:1785393681.504446:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393681.957833:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831292416:0@lo:13: 00000100:00100000:1.0:1785393681.957930:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393681.958116:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292416 00000100:00100000:2.0:1785393681.958130:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292416 00000100:00100000:2.0:1785393681.958186:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785393681.958196:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831292416:12345-0@lo:13: 00002000:00000024:2.0:1785393681.958236:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393681.958287:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831292416:12345-0@lo:13: Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393681.958294:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785393681.958451:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00212a00 x1872120831292416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393681.958472:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831292416:0@lo:13: 00010000:00010000:0.0:1785393682.531513:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393683.573724:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393684.579916:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393685.599694:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393686.559842:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831292672:0@lo:400: 00000100:00100000:1.0:1785393686.559902:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393686.559952:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393686.559957:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831292544:0@lo:400: 00000100:00100000:1.0:1785393686.559979:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393686.560003:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831292800:0@lo:400: 00000100:00100000:1.0:1785393686.560020:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393686.560034:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393686.560038:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831292928:0@lo:400: 00000100:00100000:1.0:1785393686.560056:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393686.560079:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292672 00000100:00100000:1.0:1785393686.560085:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292672 00000100:00100000:1.0:1785393686.560120:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292800 00000100:00100000:1.0:1785393686.560122:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292800 00000100:00100000:1.0:1785393686.560142:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785393686.560149:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831292672:12345-0@lo:400: 00000100:00100000:1.0:1785393686.560190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831292672:12345-0@lo:400: Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393686.560210:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785393686.560225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785393686.560230:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831292800:12345-0@lo:400: 00000100:00100000:1.0:1785393686.560255:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831292800:12345-0@lo:400: Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393686.560261:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785393686.560274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292544 00000100:00100000:1.0:1785393686.560277:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292544 00000100:00100000:1.0:1785393686.560310:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785393686.560316:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3316:x1872120831292544:12345-0@lo:400: 00000100:00100000:1.0:1785393686.560339:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3316:x1872120831292544:12345-0@lo:400: Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393686.560343:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785393686.560368:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831292928 00000100:00100000:1.0:1785393686.560370:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831292928 00000100:00100000:1.0:1785393686.560392:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785393686.560397:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831292928:12345-0@lo:400: 00000100:00100000:1.0:1785393686.560420:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831292928:12345-0@lo:400: Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393686.560425:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1785393686.560439:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393686.560443:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785393686.560469:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4a80 x1872120831292928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393686.560482:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831292928:0@lo:400: 00010000:00080000:1.0:1785393686.560491:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4e00 x1872120831292800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393686.560503:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831292800:0@lo:400: 00000100:00100000:1.0:1785393686.560525:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831292544:0@lo:400: 00010000:00080000:1.0:1785393686.560533:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4000 x1872120831292672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393686.560540:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831292672:0@lo:400: 00010000:00010000:1.0:1785393686.623890:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393687.075799:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293056:0@lo:13: 00000100:00100000:1.0:1785393687.075860:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393687.076051:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293056 00000100:00100000:1.0:1785393687.076058:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293056 00000100:00100000:1.0:1785393687.076099:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785393687.076106:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293056:12345-0@lo:13: 00002000:00000024:1.0:1785393687.076135:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393687.076172:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293056:12345-0@lo:13: Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393687.076178:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1785393687.076208:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00210700 x1872120831293056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393687.076224:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293056:0@lo:13: 00010000:00010000:2.0:1785393687.651664:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393688.672789:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393689.695847:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393690.732053:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393691.685797:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293568:0@lo:400: 00000100:00100000:3.0:1785393691.685887:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393691.685953:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393691.685960:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831293184:0@lo:400: 00000100:00100000:3.0:1785393691.685993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393691.686024:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831293312:0@lo:400: 00000100:00100000:3.0:1785393691.686053:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393691.686074:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393691.686080:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831293440:0@lo:400: 00000100:00100000:3.0:1785393691.686106:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393691.686150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293312 00000100:00100000:3.0:1785393691.686158:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293312 00000100:00100000:3.0:1785393691.686287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293440 00000100:00100000:3.0:1785393691.686307:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293440 00000100:00100000:3.0:1785393691.686390:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393691.686399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831293312:12345-0@lo:400: 00000100:00100000:3.0:1785393691.686473:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831293312:12345-0@lo:400: Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393691.686481:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393691.686498:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393691.686504:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831293440:12345-0@lo:400: 00000100:00100000:3.0:1785393691.687059:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831293440:12345-0@lo:400: Request processed in 553us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393691.687067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1785393691.687127:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785393691.687173:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00210700 x1872120831293440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393691.687197:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831293440:0@lo:400: 00010000:00080000:3.0:1785393691.687209:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00211c00 x1872120831293312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393691.687233:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831293312:0@lo:400: 00000100:00100000:0.0:1785393691.687423:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293568 00000100:00100000:0.0:1785393691.687429:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293568 00000100:00100000:0.0:1785393691.687475:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785393691.687482:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293568:12345-0@lo:400: 00000100:00100000:0.0:1785393691.687547:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293568:12345-0@lo:400: Request processed in 65us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393691.687554:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785393691.687594:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293184 00000100:00100000:0.0:1785393691.687598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293184 00000100:00100000:0.0:1785393691.687636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785393691.687643:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3315:x1872120831293184:12345-0@lo:400: 00000100:00100000:0.0:1785393691.687679:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3315:x1872120831293184:12345-0@lo:400: Request processed in 37us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393691.687685:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785393691.687739:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831293184:0@lo:400: 00010000:00080000:0.0:1785393691.687751:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00212a00 x1872120831293568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393691.687759:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293568:0@lo:400: 00000100:00080000:3.0:1785393691.687903:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785393691.743881:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393692.205878:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393692.205913:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293696:0@lo:13: 00000100:00100000:1.0:1785393692.206004:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393692.206080:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293696 00000100:00100000:1.0:1785393692.206105:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293696 00000100:00100000:1.0:1785393692.206161:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785393692.206170:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293696:12345-0@lo:13: 00002000:00000024:1.0:1785393692.206213:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393692.206270:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831293696:12345-0@lo:13: Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393692.206278:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1785393692.206325:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4700 x1872120831293696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393692.206346:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831293696:0@lo:13: 00010000:00010000:3.0:1785393692.773761:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393693.791929:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785393694.058682:0:7516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785393694.058687:0:7516:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1785393694.058857:0:7516:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93acc8926000 00000020:01000004:2.0:1785393694.058877:0:7516:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1785393694.058893:0:7516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1785393694.059711:0:7516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93acf72519c0) 00000020:00000080:2.0:1785393694.059736:0:7516:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1785393694.131736:0:7516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1785393694.132330:0:7516:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1785393694.212972:0:7516:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1785393694.225963:0:7516:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785393694.228170:0:7516:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1785393694.228245:0:7516:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785393694.228271:0:7516:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785393694.228703:0:7516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785393694.228718:0:7516:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785393694.228731:0:7516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc9b96d8b3629899 00000020:01000004:3.0:1785393694.228740:0:7516:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785393694.228767:0:7516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785393694.228772:0:7516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785393694.228778:0:7516:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785393694.228805:0:7516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785393694.228809:0:7516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1785393694.282479:0:7516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785393694.286901:0:7516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1785393694.286911:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785393694.286913:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785393694.286914:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785393694.286915:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785393694.286916:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785393694.286918:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785393694.286920:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785393694.286922:0:7516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785393694.286923:0:7516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785393694.286925:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785393694.286927:0:7516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785393694.286932:0:7516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1785393694.286935:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785393694.286936:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785393694.286937:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785393694.286939:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785393694.286940:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785393694.286941:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785393694.286942:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785393694.286943:0:7516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785393694.286944:0:7516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785393694.286953:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785393694.286953:0:7516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785393694.286990:0:7516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1785393694.287014:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831293824:0@lo:253: 00000100:00100000:1.0:1785393694.287108:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.287282:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005d26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393694.289046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293824 00000100:00100000:2.0:1785393694.289059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293824 00000100:00100000:3.0:1785393694.294782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785393694.294798:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:7516:x1872120831293824:12345-0@lo:253: 20000000:01000000:3.0:1785393694.294847:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1785393694.294851:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1785393694.294858:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1785393694.294862:0:5825:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1785393694.296478:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785393694.297290:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1785393694.297307:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1785393694.297342:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1785393694.297348:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1785393694.297372:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1785393694.297411:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1785393694.299793:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1785393694.299832:0:5825:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1785393694.299835:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1785393694.299879:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1785393694.299899:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1785393694.300550:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1785393694.300562:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1785393694.300635:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1785393694.300647:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1785393694.300680:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1785393694.303324:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1785393694.304881:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1785393694.305109:0:5825:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1785393694.305113:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1785393694.305156:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1785393694.305164:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1785393694.305192:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1785393694.305199:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1785393694.305229:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1785393694.305239:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1785393694.305303:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1785393694.305346:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1785393694.305363:0:5825:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1785393694.305366:0:5825:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1785393694.305371:0:5825:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1785393694.305386:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1785393694.305388:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1785393694.305423:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785393694.305425:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1785393694.314947:0:7518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1785393694.315202:0:7518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1785393694.315268:0:7518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1785393694.325375:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1785393694.325429:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1785393694.325504:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1785393694.325518:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1785393694.325521:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785393694.327019:0:7519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1785393694.327092:0:7519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1785393694.327138:0:7519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1785393694.327497:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1785393694.327550:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1785393694.327616:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1785393694.327631:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1785393694.327634:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785393694.328139:0:7520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1785393694.328334:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1785393694.328370:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1785393694.328424:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1785393694.328439:0:5825:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1785393694.328441:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785393694.330105:0:7521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1785393694.330217:0:7521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1785393694.330257:0:7521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1785393694.330561:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1785393694.331042:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1785393694.331118:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1785393694.331140:0:5825:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1785393694.331142:0:5825:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1785393694.331155:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785393694.331177:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331212:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331220:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331227:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331233:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331239:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331246:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331291:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331307:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.331324:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831293952:0@lo:104: 00000100:00100000:0.0:1785393694.331406:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785393694.331512:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331521:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 16 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.331536:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294080:0@lo:104: 00010000:00010000:0.0:1785393694.331565:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331601:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 16 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.331610:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294208:0@lo:104: 00010000:00010000:0.0:1785393694.331639:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331649:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 16 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.331657:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294336:0@lo:104: 00010000:00010000:0.0:1785393694.331680:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.331698:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 16 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.331706:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294464:0@lo:104: 00000100:00100000:0.0:1785393694.331726:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393694.338128:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785393694.338187:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.338291:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.350919:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.353152:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831293952 00000100:00100000:1.0:1785393694.353169:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831293952 00000100:00100000:2.0:1785393694.356070:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.356094:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294080 00000100:00100000:2.0:1785393694.356102:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294080 00000100:00100000:2.0:1785393694.356151:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294208 00000100:00100000:2.0:1785393694.356154:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294208 00000100:00100000:2.0:1785393694.356163:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294336 00000100:00100000:2.0:1785393694.356166:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294336 00000100:00100000:2.0:1785393694.356173:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294464 00000100:00100000:2.0:1785393694.356190:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294464 00000100:00100000:2.0:1785393694.356208:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785393694.356217:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:5825:x1872120831294080:12345-0@lo:104: 00010000:00010000:2.0:1785393694.356239:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356384:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785393694.356391:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:5825:x1872120831294080:12345-0@lo:104: Request processed in 176us (18207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.356399:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785393694.356418:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785393694.356424:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5825:x1872120831294208:12345-0@lo:104: 00010000:00010000:2.0:1785393694.356432:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356467:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785393694.356472:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:5825:x1872120831294208:12345-0@lo:104: Request processed in 50us (18183us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.356478:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785393694.356489:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785393694.356495:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5825:x1872120831294336:12345-0@lo:104: 00010000:00010000:2.0:1785393694.356503:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356526:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785393694.356531:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:5825:x1872120831294336:12345-0@lo:104: Request processed in 36us (5637us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.356537:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785393694.356557:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785393694.356563:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:5825:x1872120831294464:12345-0@lo:104: 00010000:00010000:2.0:1785393694.356590:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356637:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1785393694.356642:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:5825:x1872120831294464:12345-0@lo:104: Request processed in 80us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.356648:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1785393694.356669:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1785393694.356675:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356682:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cce00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393694.356697:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356708:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393694.356716:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393694.356723:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785393694.356765:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356771:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393694.356786:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356804:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cce00/0xcc9b96d8b362985a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629861 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356819:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785393694.356822:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356828:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393694.356831:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356837:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393694.356842:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393694.356847:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785393694.356858:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356863:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393694.356868:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356874:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b362983e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629845 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356883:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785393694.356890:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356896:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152be00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393694.356899:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.356906:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.356990:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1785393694.357018:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831294592:0@lo:103: 00000100:00100000:3.0:1785393694.357062:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.357121:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393694.357127:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831294720:0@lo:103: 00000100:00100000:3.0:1785393694.357146:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.357177:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294592 00000100:00100000:3.0:1785393694.357180:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294592 00010000:00010000:3.0:1785393694.357201:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 17 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.357221:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294720 00000100:00100000:3.0:1785393694.357223:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294720 00010000:00010000:3.0:1785393694.357232:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 18 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.357247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785393694.357252:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3317:x1872120831294592:12345-0@lo:103: 00010000:00010000:3.0:1785393694.357263:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393694.357268:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 18 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357278:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 18 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357297:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393694.357321:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3317:x1872120831294592:12345-0@lo:103: Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.357326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785393694.357338:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785393694.357343:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:3317:x1872120831294720:12345-0@lo:103: 00010000:00010000:3.0:1785393694.357349:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393694.357353:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 17 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357367:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 17 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357376:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393694.357396:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:3317:x1872120831294720:12345-0@lo:103: Request processed in 53us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.357401:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785393694.357440:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831294720:0@lo:103: 00000100:00100000:3.0:1785393694.357448:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831294592:0@lo:103: 00010000:00010000:3.0:1785393694.357617:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393694.357623:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357631:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cd400 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393694.357633:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357641:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393694.357648:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393694.357653:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393694.357666:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.357671:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1785393694.357777:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785393694.357786:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5825:x1872120831293952:12345-0@lo:104: 00010000:00010000:0.0:1785393694.357795:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.357838:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785393694.357843:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5825:x1872120831293952:12345-0@lo:104: Request processed in 60us (26438us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.357849:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:00010000:2.0:1785393694.359393:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393694.359400:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785393694.359433:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.359440:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393694.365553:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.365708:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831294976:0@lo:103: 00000100:00100000:0.0:1785393694.365814:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785393694.365934:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cd400/0xcc9b96d8b36297ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297f1 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.365958:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393694.365963:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.365971:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cde00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393694.365975:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.365986:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393694.365994:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393694.366000:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393694.366697:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.366705:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393694.366728:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.366735:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cde00/0xcc9b96d8b3629884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362988b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.366748:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393694.366767:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393694.366770:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393694.366788:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831295104:0@lo:103: 00000100:00100000:3.0:1785393694.366826:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.366904:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294976 00000100:00100000:3.0:1785393694.366970:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294976 00010000:00010000:3.0:1785393694.367101:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 17 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.367134:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295104 00000100:00100000:3.0:1785393694.367137:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295104 00010000:00010000:3.0:1785393694.367150:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 18 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.367170:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785393694.367179:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3316:x1872120831294976:12345-0@lo:103: 00010000:00010000:3.0:1785393694.367194:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393694.367200:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 18 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.367210:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 18 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.367230:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393694.367328:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0030200/0xcc9b96d8b3629861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362985a expref: 18 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393694.367344:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294080:0@lo:104: 00000100:00100000:1.0:1785393694.367360:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831294848:0@lo:103: 00000100:00100000:1.0:1785393694.367387:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785393694.367417:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc29cd600/0xcc9b96d8b3629845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362983e expref: 17 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393694.367426:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294208:0@lo:104: 00010000:00010000:1.0:1785393694.367436:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc29cd000/0xcc9b96d8b362981b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629814 expref: 16 pid: 5824 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393694.367457:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294336:0@lo:104: 00000100:00100000:1.0:1785393694.367468:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831294464:0@lo:104: 00000100:00100000:1.0:1785393694.367478:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1872120831293952:0@lo:104: 00010000:00010000:1.0:1785393694.367513:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368044:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368054:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152be00/0xcc9b96d8b3629814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362981b expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368094:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.368096:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.368098:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.368165:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.368167:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393694.368183:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831294848 00000100:00100000:2.0:1785393694.368187:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831294848 00010000:00010000:2.0:1785393694.368215:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 16 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393694.368232:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785393694.368239:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3317:x1872120831295104:12345-0@lo:103: 00010000:00010000:2.0:1785393694.368247:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393694.368250:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368259:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368271:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b362988b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629884 expref: 16 pid: 5825 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368282:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393694.368317:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3317:x1872120831295104:12345-0@lo:103: Request processed in 78us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.368323:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785393694.368340:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785393694.368345:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3315:x1872120831294848:12345-0@lo:103: 00010000:00010000:2.0:1785393694.368353:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393694.368357:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368365:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368374:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b36297f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36297ea expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368397:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368405:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368417:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368423:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368429:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368435:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368440:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393694.368444:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368451:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368460:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.368467:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393694.368491:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3315:x1872120831294848:12345-0@lo:103: Request processed in 145us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.368504:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785393694.368531:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831294848:0@lo:103: 00000100:00100000:2.0:1785393694.368618:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831295104:0@lo:103: 00010000:00010000:1.0:1785393694.369894:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.369919:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.369927:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785393694.369945:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1785393694.379361:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:3316:x1872120831294976:12345-0@lo:103: Request processed in 12165us (13531us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.379379:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785393694.390712:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831294976:0@lo:103: 00000100:00100000:2.0:1785393694.530542:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831293824:0@lo:253: 10000000:01000000:2.0:1785393694.530565:0:7516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785393694.530587:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785393694.530589:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785393694.530591:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785393694.530592:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1785393694.530594:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785393694.530595:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785393694.530597:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785393694.530599:0:7516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1785393694.530601:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785393694.530602:0:7516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1785393694.530627:0:7516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93acc8926000 from lustre-OST0001 10000000:01000000:2.0:1785393694.530658:0:7516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1785393694.530661:0:7516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785393694.530671:0:7516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93acc9538000 local copy 10000000:01000000:2.0:1785393694.530676:0:7516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785393694.530740:0:7516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.530753:0:7516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.530764:0:7516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393694.530784:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295232:0@lo:101: 00000100:00100000:2.0:1785393694.530856:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.530911:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393694.530946:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295232 00000100:00100000:0.0:1785393694.530954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295232 00000100:00100000:0.0:1785393694.531011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785393694.531021:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295232:12345-0@lo:101: 00010000:00010000:0.0:1785393694.531039:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1785393694.531043:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+11:7516:x1872120831293824:12345-0@lo:253: Request processed in 235598us (243285us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.531056:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:0.0:1785393694.531057:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36298a7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.531089:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36298a7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.531102:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298a7 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.531114:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031c00, rc 0) 00000100:00100000:0.0:1785393694.531150:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295232:12345-0@lo:101: Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.531156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785393694.531174:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295232:0@lo:101: 00010000:00010000:2.0:1785393694.531191:0:7516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.531202:0:7516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393694.531469:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295360:0@lo:501: 00000100:00100000:2.0:1785393694.531496:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.531515:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63240 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.531563:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295360 00000100:00100000:1.0:1785393694.531589:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295360 00000100:00100000:1.0:1785393694.531621:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785393694.531636:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295360:12345-0@lo:501: 00000100:00100000:1.0:1785393694.532157:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295360:12345-0@lo:501: Request processed in 520us (649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785393694.532173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785393694.532283:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295360:0@lo:501: 10000000:01000000:0.0:1785393694.532302:0:7516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1785393694.532338:0:7516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1785393694.532344:0:7516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.532354:0:7516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.532362:0:7516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.532386:0:7516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785393694.532409:0:7516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93acc8926000 10000000:01000000:0.0:1785393694.532414:0:7516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785393694.532420:0:7516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1785393694.532422:0:7516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785393694.532427:0:7516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1785393694.532429:0:7516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1785393694.532446:0:7516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.532453:0:7516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.532461:0:7516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.532473:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295488:0@lo:101: 00000100:00100000:0.0:1785393694.532502:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.532541:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e780 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.532566:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295488 00000100:00100000:1.0:1785393694.532589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295488 00000100:00100000:1.0:1785393694.532619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785393694.532625:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295488:12345-0@lo:101: 00010000:00010000:1.0:1785393694.532633:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393694.532644:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36298b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.532660:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.532669:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.532677:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43c00, rc 0) 00000100:00100000:1.0:1785393694.532928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831295488:12345-0@lo:101: Request processed in 301us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.532934:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1785393694.532992:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393694.533000:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.533001:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295488:0@lo:101: 00010000:00010000:0.0:1785393694.533022:0:7516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.533033:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc1d67c20) 00010000:00010000:0.0:1785393694.533034:0:7516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393694.533040:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.533053:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393694.533061:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393694.533067:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393694.533090:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.533096:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1785393694.533118:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295744:0@lo:501: 00000100:00100000:0.0:1785393694.533145:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.533173:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e780 going to sleep for 11 seconds 00010000:00010000:3.0:1785393694.533218:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.533227:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b36298a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcc9b96d8b36298ae expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.533240:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393694.533242:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393694.533244:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393694.533288:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831295616:0@lo:103: 00000100:00100000:2.0:1785393694.533321:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.533361:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295744 00000100:00100000:2.0:1785393694.533364:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295744 00000100:00100000:2.0:1785393694.533394:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785393694.533401:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831295744:12345-0@lo:501: 00000100:00100000:2.0:1785393694.533838:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831295744:12345-0@lo:501: Request processed in 436us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.533846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785393694.533935:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295744:0@lo:501: 00000100:00100000:0.0:1785393694.533960:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295872:0@lo:503: 00000100:00100000:0.0:1785393694.533998:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.534025:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1785393694.534083:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295616 00000100:00100000:3.0:1785393694.534088:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295616 00000100:00100000:2.0:1785393694.534122:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831295872 00000100:00100000:2.0:1785393694.534128:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831295872 00000100:00100000:3.0:1785393694.534138:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393694.534147:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3318:x1872120831295616:12345-0@lo:103: 00000100:00100000:2.0:1785393694.534159:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1785393694.534168:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1785393694.534169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831295872:12345-0@lo:503: 00010000:00010000:3.0:1785393694.534189:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b36298ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36298a7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.534201:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393694.534247:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3318:x1872120831295616:12345-0@lo:103: Request processed in 102us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.534254:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785393694.534343:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831295872:12345-0@lo:503: Request processed in 176us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.534358:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785393694.534412:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831295616:0@lo:103: 00000100:00100000:0.0:1785393694.534802:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831295872:0@lo:503: 00000040:00080000:0.0:1785393694.535151:0:7516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785393694.535329:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296000:0@lo:502: 00000100:00100000:0.0:1785393694.535372:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.535408:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1785393694.536825:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296000 00000100:00100000:2.0:1785393694.536838:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296000 00000100:00100000:2.0:1785393694.536907:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785393694.536918:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831296000:12345-0@lo:502: 00000100:00100000:2.0:1785393694.537180:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831296000:12345-0@lo:502: Request processed in 264us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.537275:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296000:0@lo:502: 00000040:00080000:1.0:1785393694.537668:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1785393694.537755:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1785393694.537795:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1785393694.538186:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1785393694.538227:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1785393694.538262:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1785393694.538319:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296128:0@lo:502: 00000100:00100000:1.0:1785393694.538390:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.538455:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005d2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785393694.538499:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296128 00000100:00100000:0.0:1785393694.538507:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296128 00000100:00100000:2.0:1785393694.539283:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785393694.551188:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785393694.551224:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831296128:12345-0@lo:502: 00000100:00100000:1.0:1785393694.551789:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831296128:12345-0@lo:502: Request processed in 584us (13397us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.551799:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785393694.551843:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296128:0@lo:502: 00000040:00080000:0.0:1785393694.552048:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1785393694.552070:0:7516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1785393694.553919:0:7524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785393694.553931:0:7524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1785393694.553940:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393694.553943:0:7524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1785393694.553960:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785393694.553978:0:7524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93acc85a4d40) 00000020:00000080:0.0:1785393694.554006:0:7524:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785393694.554013:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785393694.554089:0:7524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc8926000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1785393694.554097:0:7524:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785393694.554104:0:7524:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc9b96d8b36298ca 00010000:00010000:1.0:1785393694.572339:0:7524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1785393694.573080:0:7524:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1785393694.582138:0:7524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1785393694.582973:0:7524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1785393694.593457:0:7524:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1785393694.594628:0:7524:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1785393694.600194:0:7524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1785393694.600211:0:7524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393694.600220:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393694.600222:0:7524:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1785393694.600228:0:7524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785393694.600233:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393694.600234:0:7524:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785393694.600237:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785393694.600239:0:7524:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785393694.600305:0:7524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393694.600309:0:7524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393694.600310:0:7524:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785393694.600314:0:7524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1785393694.603693:0:7516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1785393694.603737:0:7516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1785393694.603765:0:7516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.603781:0:7516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393694.603791:0:7516:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc8926000 from 1 10000000:01000000:1.0:1785393694.603794:0:7516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785393694.603840:0:7516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.603848:0:7516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.603862:0:7516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393694.603896:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296256:0@lo:101: 00000100:00100000:1.0:1785393694.603987:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.604068:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005d2000 going to sleep for 11 seconds 00000100:00100000:3.0:1785393694.605945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296256 00000100:00100000:3.0:1785393694.605959:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296256 00000100:00100000:3.0:1785393694.606039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785393694.606050:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:7516:x1872120831296256:12345-0@lo:101: 00010000:00010000:3.0:1785393694.606070:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393694.606087:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36298d1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.606115:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.606143:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.606154:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152be00, rc 0) 00000100:00100000:3.0:1785393694.606235:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296256:12345-0@lo:101: Request processed in 186us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.606242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785393694.606303:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296256:0@lo:101: 00010000:00010000:3.0:1785393694.606323:0:7516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.606333:0:7516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.606451:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296384:0@lo:501: 00000100:00100000:3.0:1785393694.606480:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.606845:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296384 00000100:00100000:1.0:1785393694.606851:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296384 00000100:00100000:1.0:1785393694.606877:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785393694.606883:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296384:12345-0@lo:501: 00000100:00100000:1.0:1785393694.607142:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296384:12345-0@lo:501: Request processed in 258us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.607149:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1785393694.609739:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1785393694.609784:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296384:0@lo:501: 00000100:00100000:3.0:1785393694.609838:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296512:0@lo:503: 00000100:00100000:3.0:1785393694.609905:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.610472:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.615411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296512 00000100:00100000:1.0:1785393694.615426:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296512 00000100:00100000:1.0:1785393694.615486:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785393694.615497:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296512:12345-0@lo:503: 00000100:00100000:1.0:1785393694.616237:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296512:12345-0@lo:503: Request processed in 739us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.616246:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1785393694.617832:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296512:0@lo:503: 00000040:00080000:2.0:1785393694.618204:0:7516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785393694.618301:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296640:0@lo:502: 00000100:00100000:2.0:1785393694.618378:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.619757:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393694.619898:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296640 00000100:00100000:3.0:1785393694.619907:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296640 00000100:00100000:3.0:1785393694.619962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785393694.619973:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296640:12345-0@lo:502: 00000100:00100000:3.0:1785393694.620252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296640:12345-0@lo:502: Request processed in 280us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.620268:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1785393694.620426:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296640:0@lo:502: 00000040:00080000:2.0:1785393694.621034:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1785393694.621096:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1785393694.621131:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296768:0@lo:502: 00000100:00100000:2.0:1785393694.621178:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.621252:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393694.624771:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296768 00000100:00100000:3.0:1785393694.624788:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296768 00000100:00100000:2.0:1785393694.627938:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393694.627954:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296768:12345-0@lo:502: 00000100:00100000:2.0:1785393694.628273:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296768:12345-0@lo:502: Request processed in 323us (7095us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.628282:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785393694.628390:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296768:0@lo:502: 00000040:00080000:3.0:1785393694.628611:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1785393694.628629:0:7516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1785393694.630129:0:7528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785393694.630142:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393694.630145:0:7528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785393694.630155:0:7528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc8926000 00000020:00000080:3.0:1785393694.630157:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785393694.630175:0:7528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393694.630178:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393694.630180:0:7528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1785393694.630183:0:7528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1785393694.630319:0:7516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1785393694.630342:0:7516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393694.630366:0:7516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.630380:0:7516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393694.630430:0:7516:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1785393694.630433:0:7516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93acc8926000 10000000:01000000:0.0:1785393694.630437:0:7516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93acc8926000 10000000:01000000:0.0:1785393694.630442:0:7516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785393694.630464:0:7516:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc8926000 from 1 10000000:01000000:0.0:1785393694.630467:0:7516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785393694.630509:0:7516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.630528:0:7516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.630542:0:7516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.633937:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296896:0@lo:101: 00000100:00100000:0.0:1785393694.634034:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.634351:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.635712:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831296896 00000100:00100000:1.0:1785393694.635724:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831296896 00000100:00100000:1.0:1785393694.635786:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785393694.635798:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831296896:12345-0@lo:101: 00010000:00010000:1.0:1785393694.635818:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393694.635842:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36298df expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.635875:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.635899:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.635910:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43200, rc 0) 00000100:00100000:1.0:1785393694.635978:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831296896:12345-0@lo:101: Request processed in 182us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.635985:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785393694.636137:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831296896:0@lo:101: 00010000:00010000:0.0:1785393694.636157:0:7516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393694.636167:0:7516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393694.636298:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297024:0@lo:501: 00000100:00100000:0.0:1785393694.636328:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.636342:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393694.636763:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297024 00000100:00100000:2.0:1785393694.636775:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297024 00000100:00100000:2.0:1785393694.636799:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1785393694.636806:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297024:12345-0@lo:501: 00000100:00100000:2.0:1785393694.637082:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297024:12345-0@lo:501: Request processed in 275us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.637089:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785393694.637701:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297024:0@lo:501: 00000100:00100000:0.0:1785393694.637743:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297152:0@lo:503: 00000100:00100000:0.0:1785393694.637786:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.637812:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.638700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297152 00000100:00100000:1.0:1785393694.638707:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297152 00000100:00100000:1.0:1785393694.638734:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785393694.638741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297152:12345-0@lo:503: 00000100:00100000:1.0:1785393694.638916:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297152:12345-0@lo:503: Request processed in 173us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.638923:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785393694.639111:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297152:0@lo:503: 00000040:00080000:0.0:1785393694.639400:0:7516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785393694.639480:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297280:0@lo:502: 00000100:00100000:0.0:1785393694.639527:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.639549:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393694.639726:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297280 00000100:00100000:2.0:1785393694.639731:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297280 00000100:00100000:2.0:1785393694.639752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785393694.639758:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297280:12345-0@lo:502: 00000100:00100000:2.0:1785393694.639917:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297280:12345-0@lo:502: Request processed in 158us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.639924:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785393694.640057:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297280:0@lo:502: 00000040:00080000:0.0:1785393694.640278:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1785393694.640319:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1785393694.640346:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1785393694.640384:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1785393694.640414:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1785393694.640451:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1785393694.640489:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1785393694.640526:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1785393694.640699:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1785393694.640736:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1785393694.640763:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1785393694.640802:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1785393694.640830:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1785393694.640856:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1785393694.640892:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1785393694.640921:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1785393694.640948:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1785393694.640985:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1785393694.641013:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1785393694.641039:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1785393694.641076:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1785393694.641104:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1785393694.641130:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1785393694.641182:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1785393694.641214:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1785393694.641239:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1785393694.641277:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1785393694.641316:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1785393694.641342:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1785393694.641380:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1785393694.641408:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1785393694.641433:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1785393694.641458:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1785393694.641495:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1785393694.641525:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1785393694.652944:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1785393694.653106:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1785393694.653177:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297408:0@lo:502: 00000100:00100000:2.0:1785393694.653295:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.653342:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.653407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297408 00000100:00100000:1.0:1785393694.653416:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297408 00000100:00100000:1.0:1785393694.653477:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785393694.653506:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297408:12345-0@lo:502: 00000100:00100000:1.0:1785393694.653803:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831297408:12345-0@lo:502: Request processed in 299us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.653812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785393694.653874:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831297408:0@lo:502: 00000040:00080000:1.0:1785393694.653944:0:7516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1785393694.653958:0:7516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1785393694.655321:0:7529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1785393694.655338:0:7529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93acce5d4d40) 00000020:00000080:1.0:1785393694.655369:0:7529:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1785393694.656509:0:7529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc8926000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785393694.656515:0:7529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acc8926000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785393694.656529:0:7529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc8926000 3 00010000:00080000:1.0:1785393694.656740:0:7529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acf724f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1785393694.662219:0:7529:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1785393694.662339:0:7529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1785393694.662388:0:7529:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785393694.662401:0:7529:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcc9b96d8b36298f4 00000100:00080000:1.0:1785393694.662414:0:7529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785393694.662420:0:7529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93acf724f000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785393694.662464:0:7529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad008f5500 x1872120831297536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785393694.662485:0:7529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785393694.662773:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831297536:0@lo:38: 00000100:00100000:0.0:1785393694.662857:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.662928:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297536 00000100:00100000:0.0:1785393694.662943:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297536 00000100:00100000:0.0:1785393694.662978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785393694.662986:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1872120831297536:12345-0@lo:38: 00010000:00080000:0.0:1785393694.663011:0:5832:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1785393694.663042:0:5832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc9b96d8b36298fb 00000004:00100000:0.0:1785393694.663058:0:5832:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785393694.663091:0:5832:0:(import.c:65:import_set_state_nolock()) ffff93acf769f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785393694.663140:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872120831297536:12345-0@lo:38: Request processed in 153us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.663147:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1785393694.663189:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f5500 x1872120831297536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785393704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393694.663200:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785393694.663207:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1785393694.663214:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1785393694.663218:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785393694.663221:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf724f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785393694.663227:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831297536:0@lo:38: 00000100:00100000:3.0:1785393694.663367:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393694.663377:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831297920:0@lo:400: 00000100:00100000:3.0:1785393694.663412:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.663452:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297920 00000100:00100000:3.0:1785393694.663455:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297920 00000100:00100000:3.0:1785393694.663492:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785393694.663500:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831297920:12345-0@lo:400: 00000100:00100000:3.0:1785393694.663550:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831297920:12345-0@lo:400: Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.663556:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1785393694.663824:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785393694.663848:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00213800 x1872120831297920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393694.663858:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831297920:0@lo:400: 00000100:00100000:0.0:1785393694.663940:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831297664:0@lo:400: 00000100:00100000:0.0:1785393694.663969:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.663989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393694.663994:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831297792:0@lo:400: 00000100:00100000:0.0:1785393694.664017:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393694.664046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297664 00000100:00100000:0.0:1785393694.664050:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297664 00000100:00100000:0.0:1785393694.664074:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831297792 00000100:00100000:0.0:1785393694.664084:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831297792 00000100:00100000:0.0:1785393694.664107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785393694.664113:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831297664:12345-0@lo:400: 00000100:00100000:0.0:1785393694.664148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831297664:12345-0@lo:400: Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.664155:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785393694.664167:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785393694.664173:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831297792:12345-0@lo:400: 00000100:00100000:0.0:1785393694.664199:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831297792:12345-0@lo:400: Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.664204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1785393694.664216:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785393694.664235:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00210e00 x1872120831297792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393694.664244:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831297792:0@lo:400: 00010000:00080000:0.0:1785393694.664252:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad00210000 x1872120831297664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393694.664258:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831297664:0@lo:400: 00000040:00080000:0.0:1785393694.668230:0:7529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1785393694.668418:0:7530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7530:1872120831298048:0@lo:901: 00000100:00100000:1.0:1785393694.668494:0:7530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393694.668542:0:7530:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1785393694.669718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298048 00000100:00100000:0.0:1785393694.669730:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298048 00000100:00100000:0.0:1785393694.669790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785393694.669802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7530:x1872120831298048:12345-0@lo:901: 00000100:00100000:0.0:1785393694.670221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7530:x1872120831298048:12345-0@lo:901: Request processed in 420us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393694.670229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1785393694.670261:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785393694.671790:0:7530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad008f4380 x1872120831298048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1785393710 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393694.671810:0:7530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7530:1872120831298048:0@lo:901: 00000020:01000000:3.0:1785393694.678019:0:7516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1785393694.678065:0:7516:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785393694.678091:0:7516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.678107:0:7516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785393694.678177:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785393694.678179:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785393694.678181:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393694.678182:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785393694.678183:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393694.678184:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393694.678186:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785393694.678187:0:7516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785393694.678189:0:7516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785393694.678190:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393694.678192:0:7516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785393694.678196:0:7516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1785393694.678199:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785393694.678201:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785393694.678202:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393694.678203:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785393694.678204:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393694.678205:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393694.678207:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785393694.678208:0:7516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785393694.678209:0:7516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785393694.678210:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393694.678211:0:7516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785393694.678245:0:7516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785393694.678270:0:7516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831298176:0@lo:253: 00000100:00100000:3.0:1785393694.678351:0:7516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.678401:0:7516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.678481:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298176 00000100:00100000:1.0:1785393694.678489:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298176 00000100:00100000:1.0:1785393694.678554:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393694.678824:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7516:x1872120831298176:12345-0@lo:253: 20000000:01000000:1.0:1785393694.678858:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1785393694.678874:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1785393694.799368:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785393694.799412:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1785393694.799503:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1785393694.799509:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1785393694.799547:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.799602:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.799714:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.799768:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.799796:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393694.799817:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831298304:0@lo:104: 00000100:00100000:2.0:1785393694.799905:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393694.799967:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd08c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1785393694.800036:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298304 00000100:00100000:1.0:1785393694.800045:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298304 00000100:00100000:1.0:1785393694.800103:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785393694.800114:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831298304:12345-0@lo:104: 00010000:00010000:1.0:1785393694.800129:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393694.800184:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785393694.800191:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:5847:x1872120831298304:12345-0@lo:104: Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393694.800198:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1785393694.801212:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393694.801223:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.801233:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031000 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393694.801238:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.801249:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393694.801258:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393694.801264:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1785393694.801306:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.801311:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393694.801338:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.801346:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b362984c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629853 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.801380:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.801382:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393694.801383:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393694.801394:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393694.801410:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831298432:0@lo:103: 00000100:00100000:2.0:1785393694.801458:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393694.802270:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298432 00000100:00100000:3.0:1785393694.802284:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298432 00010000:00010000:3.0:1785393694.802316:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 15 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393694.802355:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785393694.802364:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd8efc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3317:x1872120831298432:12345-0@lo:103: 00010000:00010000:3.0:1785393694.802376:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393694.802383:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 15 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802394:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 15 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802409:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc29cc200/0xcc9b96d8b3629853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362984c expref: 15 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802426:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802435:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785393694.802453:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008679578s 00010000:00010000:3.0:1785393694.802458:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802466:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802474:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802492:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802499:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393694.802503:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.802510:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393694.803714:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1872120831298304:0@lo:104: 00010000:00010000:2.0:1785393694.803747:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.803759:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393694.803766:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.803835:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.803844:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1e00/0xcc9b96d8b3629902 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393694.803861:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393694.803947:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd8efc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3317:x1872120831298432:12345-0@lo:103: Request processed in 1583us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393694.803956:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785393694.804749:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831298432:0@lo:103: 00010000:00010000:2.0:1785393694.818805:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393694.834948:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:7516:x1872120831298176:12345-0@lo:253: Request processed in 156115us (156582us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393694.834968:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785393694.837801:0:7516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7516:1872120831298176:0@lo:253: 10000000:01000000:3.0:1785393694.837824:0:7516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1785393694.837828:0:7516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785393694.837830:0:7516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785393694.837832:0:7516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785393694.837833:0:7516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785393694.837834:0:7516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785393694.837835:0:7516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785393694.837837:0:7516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785393694.837838:0:7516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785393694.837840:0:7516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785393694.837862:0:7516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785393694.837863:0:7516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1785393694.837882:0:7516:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785393694.846829:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393694.847052:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785393694.847262:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393694.847441:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785393694.851036:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785393694.851319:0:7516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1785393694.863070:0:7516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1785393695.204676:0:7516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1785393695.204694:0:7516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1785393695.204732:0:7516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1785393695.204807:0:7516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1785393695.204827:0:7516:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1785393695.204862:0:7516:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1785393695.850381:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393696.869764:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393697.318169:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831298560:0@lo:13: 00000100:00100000:0.0:1785393697.318257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393697.318360:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298560 00000100:00100000:2.0:1785393697.318370:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298560 00000100:00100000:2.0:1785393697.318438:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785393697.318448:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831298560:12345-0@lo:13: 00002000:00000024:2.0:1785393697.318491:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1785393697.324707:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393697.324850:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831298560:12345-0@lo:13: Request processed in 6395us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393697.324865:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1785393697.326074:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00213800 x1872120831298560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393697.326105:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831298560:0@lo:13: 00010000:00010000:2.0:1785393697.890819:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393698.911709:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393699.872649:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831298816:0@lo:400: 00000100:00100000:2.0:1785393699.872736:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393699.872815:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393699.872823:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831298944:0@lo:400: 00000100:00100000:2.0:1785393699.872847:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393699.872920:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298816 00000100:00100000:0.0:1785393699.872928:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298816 00000100:00100000:1.0:1785393699.872975:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831299072:0@lo:400: 00000100:00100000:0.0:1785393699.872982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298944 00000100:00100000:0.0:1785393699.872986:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298944 00000100:00100000:0.0:1785393699.873017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785393699.873019:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393699.873032:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831298816:12345-0@lo:400: 00000100:00100000:1.0:1785393699.873056:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785393699.873065:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831298688:0@lo:400: 00000100:00100000:0.0:1785393699.873099:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831298816:12345-0@lo:400: Request processed in 69us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393699.873107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393699.873113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785393699.873138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785393699.873143:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831299200:0@lo:400: 00000100:00100000:0.0:1785393699.873148:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831298944:12345-0@lo:400: 00000100:00100000:1.0:1785393699.873176:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393699.873196:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831298944:12345-0@lo:400: Request processed in 49us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393699.873203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785393699.873206:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299072 00000100:00100000:1.0:1785393699.873211:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299072 00000100:00100000:0.0:1785393699.873216:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299200 00000100:00100000:0.0:1785393699.873222:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299200 00000100:00100000:0.0:1785393699.873248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785393699.873254:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785393699.873257:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831299200:12345-0@lo:400: 00000100:00100000:1.0:1785393699.873269:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831299072:12345-0@lo:400: 00000100:00100000:0.0:1785393699.873300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831299200:12345-0@lo:400: Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393699.873306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785393699.873327:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831299072:12345-0@lo:400: Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393699.873335:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1785393699.873375:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889dc00 x1872120831299200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393699.873401:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831299200:0@lo:400: 00010000:00080000:1.0:1785393699.873414:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7ac9500 x1872120831299072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393699.873422:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831299072:0@lo:400: 00000100:00080000:3.0:1785393699.873746:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393699.873751:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393699.873762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831298688 00000100:00100000:3.0:1785393699.873766:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831298688 00010000:00080000:2.0:1785393699.873962:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7acbb80 x1872120831298944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393699.873973:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831298944:0@lo:400: 00010000:00080000:2.0:1785393699.873983:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7ac9180 x1872120831298816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393699.873992:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831298816:0@lo:400: 00000100:00100000:3.0:1785393699.874729:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785393699.874741:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3315:x1872120831298688:12345-0@lo:400: 00000100:00100000:3.0:1785393699.874802:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:3315:x1872120831298688:12345-0@lo:400: Request processed in 65us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393699.878824:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831298688:0@lo:400: 00000100:00100000:3.0:1785393699.881586:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:2.0:1785393699.935636:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393700.967147:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785393701.408664:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785393701.408671:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc825e800 from 30 10000000:01000000:3.0:1785393701.408675:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785393701.408720:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393701.408732:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393701.408743:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393701.408766:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299328:0@lo:101: 00000100:00100000:3.0:1785393701.408830:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393701.408881:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.408938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299328 00000100:00100000:1.0:1785393701.408944:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299328 00000100:00100000:1.0:1785393701.408993:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1785393701.409001:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831299328:12345-0@lo:101: 00010000:00010000:1.0:1785393701.409014:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393701.409025:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629909 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.409045:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.409054:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.409062:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42200, rc 0) 00000100:00100000:1.0:1785393701.409093:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299328:12345-0@lo:101: Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.409098:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785393701.409167:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299328:0@lo:101: 00010000:00010000:3.0:1785393701.409187:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393701.409195:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393701.409239:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299456:0@lo:501: 00000100:00100000:3.0:1785393701.409263:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393701.409286:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.411505:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299456 00000100:00100000:1.0:1785393701.411514:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299456 00000100:00100000:1.0:1785393701.411550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785393701.411558:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299456:12345-0@lo:501: 00000100:00100000:1.0:1785393701.411945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299456:12345-0@lo:501: Request processed in 387us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.411952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785393701.411993:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299456:0@lo:501: 00000100:00100000:1.0:1785393701.412028:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299584:0@lo:503: 00000100:00100000:1.0:1785393701.412063:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.412086:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.412097:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299584 00000100:00100000:1.0:1785393701.412100:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299584 00000100:00100000:1.0:1785393701.412118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1785393701.412123:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299584:12345-0@lo:503: 00000100:00100000:1.0:1785393701.412426:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299584:12345-0@lo:503: Request processed in 302us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.412433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1785393701.412468:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299584:0@lo:503: 00000100:00100000:3.0:1785393701.413839:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7777:1872120831299712:0@lo:502: 00000100:00100000:3.0:1785393701.413884:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393701.413914:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.413962:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299712 00000100:00100000:1.0:1785393701.413966:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299712 00000100:00100000:1.0:1785393701.413997:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1785393701.414003:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7777:x1872120831299712:12345-0@lo:502: 00000100:00100000:1.0:1785393701.414212:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7777:x1872120831299712:12345-0@lo:502: Request processed in 208us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.414219:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785393701.414289:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7777:1872120831299712:0@lo:502: 00000100:00100000:3.0:1785393701.414330:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7777:1872120831299840:0@lo:502: 00000100:00100000:3.0:1785393701.414370:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393701.414389:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.414542:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299840 00000100:00100000:1.0:1785393701.414547:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299840 00000100:00100000:1.0:1785393701.414636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1785393701.414655:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7777:x1872120831299840:12345-0@lo:502: 00000100:00100000:1.0:1785393701.414772:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:7777:x1872120831299840:12345-0@lo:502: Request processed in 129us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.414778:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785393701.419073:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7777:1872120831299840:0@lo:502: 00000040:00080000:3.0:1785393701.419112:0:7777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1785393701.422293:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1785393701.422326:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785393701.422337:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.422348:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393701.422357:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1785393701.422359:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1785393701.422362:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1785393701.422398:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.422416:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.422426:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393701.422446:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299968:0@lo:101: 00000100:00100000:2.0:1785393701.423537:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393701.423594:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc85206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393701.423619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831299968 00000100:00100000:2.0:1785393701.423625:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831299968 00000100:00100000:2.0:1785393701.423681:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1785393701.423690:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831299968:12345-0@lo:101: 00010000:00010000:2.0:1785393701.423710:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393701.423722:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629917 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.423746:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.423756:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.423764:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0000, rc 0) 00000100:00100000:2.0:1785393701.423796:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831299968:12345-0@lo:101: Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393701.423802:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1785393701.423845:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831299968:0@lo:101: 00010000:00010000:2.0:1785393701.423857:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393701.423864:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393701.423908:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300096:0@lo:501: 00000100:00100000:2.0:1785393701.423944:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393701.423955:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc85206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393701.423964:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300096 00000100:00100000:2.0:1785393701.423967:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300096 00000100:00100000:2.0:1785393701.423982:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785393701.423987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831300096:12345-0@lo:501: 00000100:00100000:2.0:1785393701.424230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831300096:12345-0@lo:501: Request processed in 241us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393701.424236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785393701.424274:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300096:0@lo:501: 00000100:00100000:2.0:1785393701.424310:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300224:0@lo:503: 00000100:00100000:2.0:1785393701.424357:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393701.424368:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc85206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393701.424377:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300224 00000100:00100000:2.0:1785393701.424380:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300224 00000100:00100000:2.0:1785393701.424396:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785393701.424414:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831300224:12345-0@lo:503: 00000100:00100000:2.0:1785393701.424902:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831300224:12345-0@lo:503: Request processed in 499us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393701.424909:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785393701.424946:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300224:0@lo:503: 00000100:00100000:0.0:1785393701.430774:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7778:1872120831300352:0@lo:502: 00000100:00100000:0.0:1785393701.430848:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.430889:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.430930:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300352 00000100:00100000:1.0:1785393701.430936:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300352 00000100:00100000:1.0:1785393701.430980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1785393701.430988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:7778:x1872120831300352:12345-0@lo:502: 00000100:00100000:1.0:1785393701.431216:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:7778:x1872120831300352:12345-0@lo:502: Request processed in 228us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.431223:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1785393701.431300:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7778:1872120831300352:0@lo:502: 00000020:01000000:0.0:1785393701.431325:0:7778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393701.431332:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393701.431334:0:7778:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785393701.431339:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785393701.431340:0:7778:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785393701.431353:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7778:1872120831300480:0@lo:502: 00000100:00100000:0.0:1785393701.431382:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.431408:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.431551:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300480 00000100:00100000:1.0:1785393701.431556:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300480 00000100:00100000:1.0:1785393701.431608:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785393701.431615:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:7778:x1872120831300480:12345-0@lo:502: 00000100:00100000:1.0:1785393701.431733:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:7778:x1872120831300480:12345-0@lo:502: Request processed in 118us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.431740:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785393701.431817:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7778:1872120831300480:0@lo:502: 00000020:01000000:0.0:1785393701.431834:0:7778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393701.431838:0:7778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393701.431839:0:7778:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785393701.431842:0:7778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1785393701.431958:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1785393701.431977:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1785393701.431987:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.431997:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393701.432007:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1785393701.432009:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ace0136800 from 30 10000000:01000000:1.0:1785393701.432012:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785393701.432039:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.432047:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.432055:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393701.432066:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300608:0@lo:101: 00000100:00100000:1.0:1785393701.432090:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.432117:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.432153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300608 00000100:00100000:0.0:1785393701.432157:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300608 00000100:00100000:0.0:1785393701.432184:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785393701.432190:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831300608:12345-0@lo:101: 00010000:00010000:0.0:1785393701.432198:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393701.432210:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629925 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.432229:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.432238:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.432253:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031600, rc 0) 00000100:00100000:0.0:1785393701.432544:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831300608:12345-0@lo:101: Request processed in 353us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.432551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1785393701.432634:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300608:0@lo:101: 00010000:00010000:1.0:1785393701.432657:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.432665:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393701.432706:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300736:0@lo:501: 00000100:00100000:1.0:1785393701.432731:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.432754:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.432790:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300736 00000100:00100000:0.0:1785393701.432793:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300736 00000100:00100000:0.0:1785393701.432821:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785393701.432827:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831300736:12345-0@lo:501: 00000100:00100000:0.0:1785393701.433037:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831300736:12345-0@lo:501: Request processed in 209us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.433043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785393701.433081:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300736:0@lo:501: 00000100:00100000:0.0:1785393701.433117:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300864:0@lo:503: 00000100:00100000:0.0:1785393701.433159:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.433170:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.433180:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300864 00000100:00100000:0.0:1785393701.433182:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300864 00000100:00100000:0.0:1785393701.433199:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785393701.433203:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831300864:12345-0@lo:503: 00000100:00100000:0.0:1785393701.433318:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831300864:12345-0@lo:503: Request processed in 113us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.433324:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785393701.433353:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831300864:0@lo:503: 00000100:00100000:1.0:1785393701.439180:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7779:1872120831300992:0@lo:502: 00000100:00100000:1.0:1785393701.439259:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.439298:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8711c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.439860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831300992 00000100:00100000:0.0:1785393701.439872:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831300992 00000100:00100000:0.0:1785393701.439918:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1785393701.439925:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:7779:x1872120831300992:12345-0@lo:502: 00000100:00100000:0.0:1785393701.440174:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:7779:x1872120831300992:12345-0@lo:502: Request processed in 248us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.440181:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1785393701.440263:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7779:1872120831300992:0@lo:502: 00000100:00100000:1.0:1785393701.440305:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7779:1872120831301120:0@lo:502: 00000100:00100000:1.0:1785393701.440349:0:7779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.440380:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8711c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.441231:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301120 00000100:00100000:0.0:1785393701.441236:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301120 00000100:00100000:0.0:1785393701.441260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785393701.441265:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:7779:x1872120831301120:12345-0@lo:502: 00000100:00100000:0.0:1785393701.441413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:7779:x1872120831301120:12345-0@lo:502: Request processed in 135us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.441419:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785393701.441487:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7779:1872120831301120:0@lo:502: 00000040:00080000:0.0:1785393701.441507:0:7779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1785393701.441856:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1785393701.441872:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785393701.441881:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.441891:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393701.441899:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785393701.441902:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ace0136800 from 5 10000000:01000000:0.0:1785393701.441904:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785393701.441929:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.441945:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.441953:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393701.441964:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301248:0@lo:101: 00000100:00100000:0.0:1785393701.441990:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.442011:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.442022:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301248 00000100:00100000:0.0:1785393701.442025:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301248 00000100:00100000:0.0:1785393701.442043:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785393701.442048:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831301248:12345-0@lo:101: 00010000:00010000:0.0:1785393701.442056:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393701.442066:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b362993a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629933 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442083:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b362993a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629933 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442092:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b362993a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629933 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442099:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031c00, rc 0) 00000100:00100000:0.0:1785393701.442121:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831301248:12345-0@lo:101: Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.442126:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785393701.442151:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301248:0@lo:101: 00010000:00010000:0.0:1785393701.442166:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442173:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393701.442204:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301376:0@lo:256: 00000100:00100000:0.0:1785393701.442228:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.442238:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.442247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301376 00000100:00100000:0.0:1785393701.442250:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301376 00000100:00100000:0.0:1785393701.442265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785393701.442270:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831301376:12345-0@lo:256: 20000000:01000000:0.0:1785393701.442281:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1785393701.442296:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1785393701.442299:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1785393701.442357:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831301376:12345-0@lo:256: Request processed in 86us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.442363:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785393701.442385:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301376:0@lo:256: 10000000:01000000:0.0:1785393701.442414:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785393701.442419:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442425:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393701.442431:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1785393701.442436:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1785393701.442438:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785393701.442457:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442464:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.442937:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393701.442952:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301504:0@lo:101: 00000100:00100000:0.0:1785393701.442975:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.443002:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.443012:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301504 00000100:00100000:0.0:1785393701.443016:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301504 00000100:00100000:0.0:1785393701.443034:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1785393701.443039:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831301504:12345-0@lo:101: 00010000:00010000:0.0:1785393701.443046:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393701.443053:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629941 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.443065:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.443072:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.443079:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045400, rc 0) 00000100:00100000:0.0:1785393701.443101:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831301504:12345-0@lo:101: Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.443112:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1785393701.443139:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301504:0@lo:101: 00010000:00010000:0.0:1785393701.443148:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.443155:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393701.443187:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301632:0@lo:501: 00000100:00100000:0.0:1785393701.443207:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.443218:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.443226:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301632 00000100:00100000:0.0:1785393701.443229:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301632 00000100:00100000:0.0:1785393701.443245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785393701.443249:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831301632:12345-0@lo:501: 00000100:00100000:0.0:1785393701.443436:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831301632:12345-0@lo:501: Request processed in 185us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.443442:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785393701.443466:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301632:0@lo:501: 00000100:00100000:0.0:1785393701.443720:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301760:0@lo:503: 00000100:00100000:0.0:1785393701.443811:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.443829:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.443838:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301760 00000100:00100000:0.0:1785393701.443841:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301760 00000100:00100000:0.0:1785393701.443858:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785393701.443863:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831301760:12345-0@lo:503: 00000100:00100000:0.0:1785393701.444123:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831301760:12345-0@lo:503: Request processed in 258us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.444129:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785393701.444162:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831301760:0@lo:503: 00000100:00100000:0.0:1785393701.446187:0:7783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7783:1872120831301888:0@lo:502: 00000100:00100000:0.0:1785393701.446241:0:7783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.446268:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831301888 00000100:00100000:0.0:1785393701.446272:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831301888 00000100:00100000:0.0:1785393701.446301:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1785393701.446308:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:7783:x1872120831301888:12345-0@lo:502: 00000100:00100000:0.0:1785393701.450378:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:7783:x1872120831301888:12345-0@lo:502: Request processed in 4061us (4128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.450393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785393701.450880:0:7783:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890df00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393701.450907:0:7783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7783:1872120831301888:0@lo:502: 00000020:01000000:3.0:1785393701.451318:0:7783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785393701.451325:0:7783:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1785393701.451333:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393701.451335:0:7783:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1785393701.451340:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1785393701.451343:0:7783:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1785393701.451374:0:7783:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1785393701.451378:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785393701.451413:0:7783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93acf9663380) 00000020:00000080:3.0:1785393701.452007:0:7783:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1785393701.452019:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1785393701.452099:0:7783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1785393701.452106:0:7783:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1785393701.452115:0:7783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b3629956 00010000:00080000:3.0:1785393701.452146:0:7783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acc830f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785393701.452373:0:7783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1785393701.456720:0:7783:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1785393701.456893:0:7783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1785393701.457906:0:7783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785393701.459228:0:7783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785393701.460037:0:7783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1785393701.460095:0:7783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1785393701.469363:0:7784:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393701.469372:0:7784:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1785393701.471110:0:7783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785393701.471120:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785393701.471152:0:7783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1785393701.471170:0:7783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362995d 00000100:00080000:0.0:1785393701.471180:0:7783:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785393701.471185:0:7783:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acc830f000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1785393701.471216:0:7783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf75a6d80 x1872120831302016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785393701.471242:0:7783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1785393701.471318:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831302144:0@lo:400: 00000100:00100000:0.0:1785393701.471373:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.471413:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393701.471419:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831302272:0@lo:400: 00000100:00100000:0.0:1785393701.471458:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.471494:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831302400:0@lo:400: 00000100:00100000:0.0:1785393701.471529:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.471545:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393701.471550:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831302528:0@lo:400: 00000100:00100000:0.0:1785393701.471604:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.471632:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302144 00000100:00100000:0.0:1785393701.471637:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302144 00000100:00100000:0.0:1785393701.471676:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302272 00000100:00100000:0.0:1785393701.471679:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302272 00000100:00100000:0.0:1785393701.471695:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302528 00000100:00100000:0.0:1785393701.471697:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302528 00000100:00100000:0.0:1785393701.471710:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785393701.471717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831302144:12345-0@lo:400: 00000100:00100000:0.0:1785393701.471887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831302144:12345-0@lo:400: Request processed in 169us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.471894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785393701.471908:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785393701.471913:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831302272:12345-0@lo:400: 00000100:00100000:0.0:1785393701.471934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831302272:12345-0@lo:400: Request processed in 21us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.471939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785393701.471948:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785393701.471952:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831302528:12345-0@lo:400: 00000100:00100000:0.0:1785393701.471974:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831302528:12345-0@lo:400: Request processed in 21us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.471979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785393701.472002:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302400 00000100:00100000:0.0:1785393701.472005:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302400 00000100:00100000:0.0:1785393701.472026:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785393701.472032:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831302400:12345-0@lo:400: 00000100:00100000:0.0:1785393701.472056:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831302400:12345-0@lo:400: Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.472061:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1785393701.472084:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393701.472087:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785393701.472107:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a6a00 x1872120831302272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.472119:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831302272:0@lo:400: 00010000:00080000:0.0:1785393701.472127:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a5880 x1872120831302144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.472135:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831302144:0@lo:400: 00010000:00080000:0.0:1785393701.472156:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a6680 x1872120831302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.472164:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831302528:0@lo:400: 00010000:00080000:0.0:1785393701.472171:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a7b80 x1872120831302400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.472179:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831302400:0@lo:400: 00000020:01000000:0.0:1785393701.472218:0:7783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393701.472222:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393701.472224:0:7783:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1785393701.472227:0:7783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393701.472230:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393701.472236:0:7783:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785393701.472239:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785393701.472241:0:7783:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785393701.472261:0:7783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7783:1872120831302656:0@lo:502: 00000100:00100000:0.0:1785393701.472300:0:7783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.472319:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302656 00000100:00100000:0.0:1785393701.472322:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302656 00000100:00100000:0.0:1785393701.472341:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1785393701.472346:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:7783:x1872120831302656:12345-0@lo:502: 00000100:00100000:0.0:1785393701.473659:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:7783:x1872120831302656:12345-0@lo:502: Request processed in 1308us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.473668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785393701.473841:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831302016:0@lo:8: 00000100:00100000:1.0:1785393701.473879:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.473914:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302016 00000100:00100000:1.0:1785393701.473918:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302016 00000100:00100000:1.0:1785393701.473943:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785393701.473948:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1872120831302016:12345-0@lo:8: 00010000:00080000:1.0:1785393701.473972:0:6630:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1785393701.474000:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b3629964 00002000:00100000:1.0:1785393701.474014:0:6630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93acf724d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1785393701.474018:0:6630:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1785393701.474021:0:6630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1785393701.474128:0:6630:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1785393701.474266:0:6630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785393701.474286:0:6630:0:(import.c:65:import_set_state_nolock()) ffff93acf7249800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785393701.474321:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1872120831302016:12345-0@lo:8: Request processed in 372us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.474327:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1785393701.474357:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a6d80 x1872120831302016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785393711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393701.474366:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785393701.474372:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1785393701.474379:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1785393701.474383:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1785393701.474385:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc830f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1785393701.474412:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1785393701.474417:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831302016:0@lo:8: 00000100:00100000:0.0:1785393701.474619:0:7783:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d780 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.474635:0:7783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:7783:1872120831302656:0@lo:502: 00000020:01000000:0.0:1785393701.474672:0:7783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393701.474680:0:7783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393701.474682:0:7783:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785393701.474686:0:7783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:1.0:1785393701.474817:0:7784:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1785393701.474910:0:7784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 233506339307ns, next at 0ns, rc = 0 00000020:01000000:0.0:1785393701.475295:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1785393701.475313:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1785393701.475322:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.475333:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393701.475344:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1785393701.475347:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93acc9538000 from 1 10000000:01000000:0.0:1785393701.475350:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1785393701.475383:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.475391:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.475630:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393701.475657:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831302784:0@lo:101: 00000100:00100000:0.0:1785393701.475695:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.475726:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d780 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.475977:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302784 00000100:00100000:1.0:1785393701.475983:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302784 00000100:00100000:1.0:1785393701.476015:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393701.476023:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831302784:12345-0@lo:101: 00010000:00010000:1.0:1785393701.476033:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393701.476046:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362996b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.476067:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.476077:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.476085:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42000, rc 0) 00000100:00100000:1.0:1785393701.476116:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831302784:12345-0@lo:101: Request processed in 93us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.476122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393701.488015:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831302784:0@lo:101: 00010000:00010000:1.0:1785393701.488045:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393701.488058:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393701.488150:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831302912:0@lo:501: 00000100:00100000:1.0:1785393701.488206:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.488245:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831302912 00000100:00100000:1.0:1785393701.488251:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831302912 00000100:00100000:1.0:1785393701.488289:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785393701.488298:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831302912:12345-0@lo:501: 00000100:00100000:1.0:1785393701.488495:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831302912:12345-0@lo:501: Request processed in 197us (287us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785393701.488503:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1785393701.489666:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eefa80 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.489684:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831302912:0@lo:501: 10000000:01000000:0.0:1785393701.489711:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1785393701.489719:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393701.489728:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785393701.554337:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1785393701.603116:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1785393701.603140:0:7785:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1785393701.603169:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303168:0@lo:7: 00000100:00100000:0.0:1785393701.603236:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.603283:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.603317:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303168 00000100:00100000:0.0:1785393701.603323:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303168 00000100:00100000:0.0:1785393701.603378:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785393701.603397:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7785:x1872120831303168:12345-0@lo:7: 00000100:00080000:1.0:1785393701.604627:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393701.606171:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831303040:0@lo:13: 00000100:00100000:3.0:1785393701.606227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.613697:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303040 00000100:00100000:1.0:1785393701.613710:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303040 00000100:00100000:1.0:1785393701.613766:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785393701.613776:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831303040:12345-0@lo:13: 00002000:00000024:1.0:1785393701.613808:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1785393701.613884:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831303040:12345-0@lo:13: Request processed in 110us (7656us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393701.613890:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1785393701.614750:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b09f80 x1872120831303040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393701.614771:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831303040:0@lo:13: 00002000:00080000:0.0:1785393701.616265:0:6632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1785393701.616271:0:6632:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1785393701.616341:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7785:x1872120831303168:12345-0@lo:7: Request processed in 12943us (13103us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.616349:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1785393701.616617:0:7785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b09180 x1872120831303168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785393717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393701.616631:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303168:0@lo:7: 00000004:00080000:1.0:1785393701.616650:0:7785:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1785393701.616683:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303296:0@lo:5: 00000100:00100000:1.0:1785393701.616714:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393701.616753:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393701.617403:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303296 00000100:00100000:0.0:1785393701.617409:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303296 00000100:00100000:0.0:1785393701.617440:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785393701.617448:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7785:x1872120831303296:12345-0@lo:5: 00002000:00080000:0.0:1785393701.617471:0:6631:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1785393701.617474:0:6631:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1785393701.617707:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7785:x1872120831303296:12345-0@lo:5: Request processed in 259us (991us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1785393701.617713:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1785393701.617737:0:7785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad008f7100 x1872120831303296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785393717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.617747:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303296:0@lo:5: 00000004:00080000:0.0:1785393701.617755:0:7785:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1785393701.617775:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303424:0@lo:700: 00000100:00100000:0.0:1785393701.617796:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.617814:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81eecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393701.618000:0:6638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303424 00000100:00100000:3.0:1785393701.618004:0:6638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303424 00000100:00100000:3.0:1785393701.618035:0:6638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393701.618041:0:6638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7785:x1872120831303424:12345-0@lo:700: 00000100:00100000:3.0:1785393701.618066:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6638:1872120831303552:0@lo:700: 00000100:00100000:3.0:1785393701.618104:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393701.618135:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b540 going to sleep for 11 seconds 00000100:00100000:1.0:1785393701.618170:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303552 00000100:00100000:1.0:1785393701.618173:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303552 00000100:00100000:1.0:1785393701.618203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785393701.618209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6638:x1872120831303552:12345-0@lo:700: 40000000:02000000:0.0:1785393701.719442:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1785393701.742242:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6638:x1872120831303552:12345-0@lo:700: Request processed in 124025us (124129us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393701.742255:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785393701.742416:0:6638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00212680 x1872120831303552/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785393717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393701.742441:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6638:1872120831303552:0@lo:700: 40000000:02000000:3.0:1785393701.742461:0:6638:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1785393701.846724:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1785393701.846745:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1785393701.846855:0:6638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7785:x1872120831303424:12345-0@lo:700: Request processed in 228810us (229053us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393701.846869:0:6638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785393701.846965:0:7785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b0a300 x1872120831303424/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785393717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393701.846976:0:7785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1785393701.846993:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303424:0@lo:700: 00000004:02000040:0.0:1785393701.902339:0:7785:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1785393701.905398:0:7785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303680:0@lo:5: 00000100:00100000:0.0:1785393701.905458:0:7785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393701.905501:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303680 00000100:00100000:0.0:1785393701.905506:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303680 00000100:00100000:0.0:1785393701.905545:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785393701.905553:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7785:x1872120831303680:12345-0@lo:5: 00000100:00100000:1.0:1785393701.906102:0:7785:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88d8600 going to sleep for 11 seconds 00002000:00080000:0.0:1785393701.920813:0:6632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1785393701.920833:0:6632:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1785393701.928384:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7785:x1872120831303680:12345-0@lo:5: Request processed in 22824us (22919us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1785393701.928395:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1785393701.928552:0:7785:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b0a300 x1872120831303680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785393717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393701.928567:0:7785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7785:1872120831303680:0@lo:5: 00000004:00080000:1.0:1785393701.928595:0:7785:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1785393701.986710:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393702.432868:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393702.432890:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831303808:0@lo:13: 00000100:00100000:3.0:1785393702.432946:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393702.433015:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303808 00000100:00100000:3.0:1785393702.433021:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303808 00000100:00100000:3.0:1785393702.433060:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785393702.433067:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831303808:12345-0@lo:13: 00002000:00000024:3.0:1785393702.433096:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393702.433132:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831303808:12345-0@lo:13: Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393702.433138:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1785393702.433172:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00212680 x1872120831303808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393702.433188:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831303808:0@lo:13: 00010000:00010000:2.0:1785393703.007785:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785393703.840103:0:7881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785393704.031813:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393705.056706:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393706.081322:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393706.532855:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831304192:0@lo:400: 00000100:00100000:2.0:1785393706.532914:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393706.534047:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393706.534066:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831304320:0@lo:400: 00000100:00100000:2.0:1785393706.534094:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393706.534242:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831304064:0@lo:400: 00000100:00100000:1.0:1785393706.534269:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393706.534293:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831304576:0@lo:400: 00000100:00100000:1.0:1785393706.534309:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393706.534329:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785393706.534334:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831303936:0@lo:400: 00000100:00100000:1.0:1785393706.534357:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393706.534373:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831304448:0@lo:400: 00000100:00100000:1.0:1785393706.534389:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393706.534409:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304320 00000100:00100000:1.0:1785393706.534414:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304320 00000100:00100000:1.0:1785393706.534456:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304576 00000100:00100000:1.0:1785393706.534459:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304576 00000100:00100000:1.0:1785393706.534474:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785393706.534481:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831304320:12345-0@lo:400: 00000100:00100000:1.0:1785393706.534523:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831304320:12345-0@lo:400: Request processed in 42us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393706.534534:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785393706.534549:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785393706.534554:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831304576:12345-0@lo:400: 00000100:00100000:1.0:1785393706.534600:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831304576:12345-0@lo:400: Request processed in 45us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393706.534616:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785393706.534644:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831303936 00000100:00100000:1.0:1785393706.534647:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831303936 00000100:00100000:1.0:1785393706.534666:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785393706.534671:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831303936:12345-0@lo:400: 00000100:00100000:1.0:1785393706.534695:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831303936:12345-0@lo:400: Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393706.534700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1785393706.534719:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393706.534722:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393706.534744:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831303936:0@lo:400: 00010000:00080000:1.0:1785393706.534756:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889d500 x1872120831304576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393706.534767:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831304576:0@lo:400: 00010000:00080000:1.0:1785393706.534791:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889fb80 x1872120831304320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393706.534799:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831304320:0@lo:400: 00000100:00100000:2.0:1785393706.534894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304192 00000100:00100000:2.0:1785393706.534898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304192 00000100:00100000:2.0:1785393706.534926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304064 00000100:00100000:2.0:1785393706.534929:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304064 00000100:00100000:2.0:1785393706.534938:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304448 00000100:00100000:2.0:1785393706.534939:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304448 00000100:00100000:2.0:1785393706.534950:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393706.534955:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831304192:12345-0@lo:400: 00000100:00100000:2.0:1785393706.534987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831304192:12345-0@lo:400: Request processed in 31us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393706.534992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393706.535001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393706.535006:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831304064:12345-0@lo:400: 00000100:00100000:2.0:1785393706.535029:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831304064:12345-0@lo:400: Request processed in 23us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393706.535034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393706.535043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785393706.535048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831304448:12345-0@lo:400: 00000100:00100000:2.0:1785393706.535067:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831304448:12345-0@lo:400: Request processed in 19us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393706.535071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1785393706.535094:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889c380 x1872120831304448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393706.535102:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831304448:0@lo:400: 00010000:00080000:2.0:1785393706.535110:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889e680 x1872120831304064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393706.535123:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831304064:0@lo:400: 00000100:00080000:1.0:1785393706.535217:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785393706.535233:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889f800 x1872120831304192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393706.535253:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831304192:0@lo:400: 00000100:00100000:1.0:1785393707.053847:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831304704:0@lo:13: 00000100:00100000:1.0:1785393707.053911:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393707.053974:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304704 00000100:00100000:1.0:1785393707.053981:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304704 00000100:00100000:1.0:1785393707.054020:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785393707.054027:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1872120831304704:12345-0@lo:13: 00002000:00000024:1.0:1785393707.054056:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393707.054092:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1872120831304704:12345-0@lo:13: Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393707.054098:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1785393707.054136:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad008f7100 x1872120831304704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393707.054154:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831304704:0@lo:13: 00010000:00010000:2.0:1785393707.110754:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785393707.159324:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1785393707.551742:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831304832:0@lo:13: 00000100:00100000:1.0:1785393707.551804:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393707.551908:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304832 00000100:00100000:3.0:1785393707.551916:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304832 00000100:00100000:3.0:1785393707.551962:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785393707.551971:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831304832:12345-0@lo:13: 00002000:00000024:3.0:1785393707.552001:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393707.552058:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831304832:12345-0@lo:13: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393707.552065:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1785393707.552099:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00212680 x1872120831304832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393707.552116:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831304832:0@lo:13: 00010000:00010000:2.0:1785393708.129887:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393709.151711:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393710.183360:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393710.539994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393710.541707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807161984 00000100:00100000:3.0:1785393710.541721:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807161984 00000100:00100000:3.0:1785393710.541777:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1785393710.541787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1872120807161984:12345-192.168.203.12@tcp:250: 00010000:00080000:3.0:1785393710.541817:0:5825:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2f46be8a-a627-4a5a-a70c-b3de933a0da6@192.168.203.12@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1785393710.541847:0:5825:0:(genops.c:1406:class_connect()) connect: client 2f46be8a-a627-4a5a-a70c-b3de933a0da6, cookie 0xcc9b96d8b3629979 00000100:00080000:3.0:1785393710.542031:0:5825:0:(import.c:65:import_set_state_nolock()) ffff93abc2042800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785393710.542120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+5:2357:x1872120807161984:12345-192.168.203.12@tcp:250: Request processed in 333us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393710.542129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1785393710.546799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393710.547826:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162112 00000100:00100000:2.0:1785393710.547843:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162112 00000100:00100000:2.0:1785393710.547923:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1785393710.547938:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+5:5567:x1872120807162112:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1785393710.547962:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393710.547987:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd4b7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.548024:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.548038:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.548048:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0e00, rc 0) 00000100:00100000:2.0:1785393710.548970:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+6:5567:x1872120807162112:12345-192.168.203.12@tcp:101: Request processed in 1033us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393710.548978:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1785393710.558878:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393710.559478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162240 00000100:00100000:3.0:1785393710.559493:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162240 00000100:00100000:3.0:1785393710.560851:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1785393710.560865:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+6:5567:x1872120807162240:12345-192.168.203.12@tcp:501: 00000100:00100000:3.0:1785393710.561336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+6:5567:x1872120807162240:12345-192.168.203.12@tcp:501: Request processed in 475us (2471us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785393710.561343:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1785393710.571856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393710.572072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162368 00000100:00100000:1.0:1785393710.572082:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162368 00000100:00100000:1.0:1785393710.572133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1785393710.572142:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+6:5567:x1872120807162368:12345-192.168.203.12@tcp:101: 00010000:00010000:1.0:1785393710.572158:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393710.572181:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd4be expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393710.572207:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393710.572218:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393710.572227:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43400, rc 0) 00000100:00100000:1.0:1785393710.572279:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+7:5567:x1872120807162368:12345-192.168.203.12@tcp:101: Request processed in 138us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393710.572286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1785393710.574491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393710.574514:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162496 00000100:00100000:1.0:1785393710.574520:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162496 00000100:00100000:1.0:1785393710.574546:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1785393710.574552:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+7:5567:x1872120807162496:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1785393710.574783:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5567:x1872120807162496:12345-192.168.203.12@tcp:501: Request processed in 230us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393710.574791:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1785393710.582283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393710.586738:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162624 00000100:00100000:1.0:1785393710.586750:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162624 00000100:00100000:1.0:1785393710.586809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1785393710.586819:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5567:x1872120807162624:12345-192.168.203.12@tcp:503: 00000100:00100000:1.0:1785393710.587095:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5567:x1872120807162624:12345-192.168.203.12@tcp:503: Request processed in 276us (4817us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393710.587103:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1785393710.589296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393710.589326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162752 00000100:00100000:1.0:1785393710.589332:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162752 00000100:00100000:1.0:1785393710.589522:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1785393710.589537:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5586:x1872120807162752:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1785393710.589963:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5586:x1872120807162752:12345-192.168.203.12@tcp:502: Request processed in 429us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393710.589972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1785393710.641662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393710.641736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807162880 00000100:00100000:2.0:1785393710.641745:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807162880 00000100:00100000:2.0:1785393710.641795:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:2.0:1785393710.641804:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5586:x1872120807162880:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1785393710.642027:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5586:x1872120807162880:12345-192.168.203.12@tcp:502: Request processed in 224us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393710.642040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1785393710.654979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393710.655299:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163008 00000100:00100000:2.0:1785393710.655308:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163008 00000100:00100000:2.0:1785393710.655359:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1785393710.655367:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5567:x1872120807163008:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1785393710.655381:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393710.655396:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1600/0xcc9b96d8b362998e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd4e8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.655430:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1600/0xcc9b96d8b362998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4e8 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.655440:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1600/0xcc9b96d8b362998e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4e8 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393710.655448:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1600, rc 0) 00000100:00100000:2.0:1785393710.655500:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5567:x1872120807163008:12345-192.168.203.12@tcp:101: Request processed in 134us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393710.655506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1785393710.667787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393710.667956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163136 00000100:00100000:3.0:1785393710.667965:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163136 00000100:00100000:3.0:1785393710.668013:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1785393710.668021:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5567:x1872120807163136:12345-192.168.203.12@tcp:256: 20000000:01000000:3.0:1785393710.668043:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1785393710.668064:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1785393710.668068:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1785393710.668071:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1785393710.668073:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1785393710.672655:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5567:x1872120807163136:12345-192.168.203.12@tcp:256: Request processed in 4624us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393710.672668:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1785393710.679873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393710.682829:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163264 00000100:00100000:0.0:1785393710.682840:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163264 00000100:00100000:0.0:1785393710.682900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1785393710.682908:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5567:x1872120807163264:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1785393710.682942:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393710.682958:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd4ef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393710.682983:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393710.682994:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393710.683004:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393710.683053:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5567:x1872120807163264:12345-192.168.203.12@tcp:101: Request processed in 146us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393710.683060:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1785393710.685680:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393710.694754:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163392 00000100:00100000:0.0:1785393710.694768:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163392 00000100:00100000:0.0:1785393710.694840:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1785393710.694851:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5567:x1872120807163392:12345-192.168.203.12@tcp:501: 00000100:00100000:0.0:1785393710.695104:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5567:x1872120807163392:12345-192.168.203.12@tcp:501: Request processed in 253us (9427us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393710.695111:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1785393710.710619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393710.710749:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163520 00000100:00100000:0.0:1785393710.710760:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163520 00000100:00100000:0.0:1785393710.710815:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1785393710.710824:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5567:x1872120807163520:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1785393710.711156:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5567:x1872120807163520:12345-192.168.203.12@tcp:503: Request processed in 331us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393710.711173:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1785393710.717747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393710.718003:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163648 00000100:00100000:1.0:1785393710.718013:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163648 00000100:00100000:1.0:1785393710.718060:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1785393710.718069:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5590:x1872120807163648:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1785393710.718286:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5590:x1872120807163648:12345-192.168.203.12@tcp:502: Request processed in 218us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393710.718294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1785393710.725382:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393710.727181:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163776 00000100:00100000:3.0:1785393710.727193:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163776 00000100:00100000:3.0:1785393710.727248:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:3.0:1785393710.727257:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5590:x1872120807163776:12345-192.168.203.12@tcp:502: 00000100:00100000:3.0:1785393710.727473:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5590:x1872120807163776:12345-192.168.203.12@tcp:502: Request processed in 216us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393710.727481:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1785393710.735049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393710.738950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807163904 00000100:00100000:3.0:1785393710.738963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807163904 00000100:00100000:3.0:1785393710.739006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1785393710.739013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1872120807163904:12345-192.168.203.12@tcp:38: 00010000:00080000:3.0:1785393710.739041:0:5831:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1785393710.739083:0:5831:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b362999c 00000004:00100000:3.0:1785393710.739110:0:5831:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785393710.739116:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1785393710.829805:0:5831:0:(import.c:65:import_set_state_nolock()) ffff93abc2046000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785393710.829881:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807163904:12345-192.168.203.12@tcp:38: Request processed in 90867us (94841us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393710.829892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00010000:00010000:0.0:1785393711.203596:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393711.648833:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831305344:0@lo:400: 00000100:00100000:1.0:1785393711.648895:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393711.648949:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785393711.648954:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831305216:0@lo:400: 00000100:00100000:1.0:1785393711.648973:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393711.648998:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305344 00000100:00100000:1.0:1785393711.649003:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305344 00000100:00100000:1.0:1785393711.649048:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785393711.649056:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831305344:12345-0@lo:400: 00000100:00100000:1.0:1785393711.649102:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831305344:12345-0@lo:400: Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393711.649115:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785393711.649136:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305216 00000100:00100000:1.0:1785393711.649139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305216 00000100:00100000:1.0:1785393711.649159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785393711.649164:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831305216:12345-0@lo:400: 00000100:00100000:1.0:1785393711.649192:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831305216:12345-0@lo:400: Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393711.649197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1785393711.649209:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393711.649213:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785393711.649234:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad008f7100 x1872120831305216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393711.649247:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831305216:0@lo:400: 00010000:00080000:1.0:1785393711.649255:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98a680 x1872120831305344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393711.649263:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831305344:0@lo:400: 00000100:00100000:2.0:1785393711.649328:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831305088:0@lo:400: 00000100:00100000:2.0:1785393711.649354:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393711.649376:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831305600:0@lo:400: 00000100:00100000:2.0:1785393711.649391:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393711.649412:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785393711.649416:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831304960:0@lo:400: 00000100:00100000:2.0:1785393711.649444:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393711.649459:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831305472:0@lo:400: 00000100:00100000:2.0:1785393711.649475:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393711.649493:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305600 00000100:00100000:2.0:1785393711.649507:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305600 00000100:00100000:2.0:1785393711.649533:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785393711.649538:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831305600:12345-0@lo:400: 00000100:00100000:2.0:1785393711.649566:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831305600:12345-0@lo:400: Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393711.649597:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1785393711.649610:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393711.649616:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305088 00000100:00100000:2.0:1785393711.649618:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305088 00000100:00100000:2.0:1785393711.649629:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305472 00000100:00100000:2.0:1785393711.649631:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305472 00000100:00100000:2.0:1785393711.649645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393711.649649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831305088:12345-0@lo:400: 00000100:00100000:2.0:1785393711.649671:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831305088:12345-0@lo:400: Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393711.649676:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393711.649684:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393711.649688:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831305472:12345-0@lo:400: 00000100:00100000:2.0:1785393711.649705:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831305472:12345-0@lo:400: Request processed in 17us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393711.649709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1785393711.649718:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785393711.649732:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98b800 x1872120831305472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393711.649745:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831305472:0@lo:400: 00010000:00080000:2.0:1785393711.649753:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7ac9500 x1872120831305088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393711.649760:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831305088:0@lo:400: 00010000:00080000:2.0:1785393711.649767:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98bb80 x1872120831305600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393711.649774:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1785393711.649783:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831305600:0@lo:400: 00000100:00100000:0.0:1785393711.650126:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831304960 00000100:00100000:0.0:1785393711.650131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831304960 00000100:00100000:0.0:1785393711.650164:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1785393711.650171:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831304960:12345-0@lo:400: 00000100:00100000:0.0:1785393711.650218:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831304960:12345-0@lo:400: Request processed in 47us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393711.650223:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1785393711.650415:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831304960:0@lo:400: 00000100:00100000:0.0:1785393711.847215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393711.847267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393711.847344:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164032 00000100:00100000:1.0:1785393711.847354:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164032 00000100:00100000:1.0:1785393711.847432:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164160 00000100:00100000:1.0:1785393711.847435:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164160 00000100:00100000:1.0:1785393711.847452:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785393711.847461:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:0:x1872120807164032:12345-192.168.203.12@tcp:41: 00000004:00000024:1.0:1785393711.847509:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785393711.847567:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:0:x1872120807164032:12345-192.168.203.12@tcp:41: Request processed in 107us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393711.847615:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785393711.847645:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785393711.847651:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164160:12345-192.168.203.12@tcp:41: 00000004:00000024:1.0:1785393711.847662:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785393711.847683:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164160:12345-192.168.203.12@tcp:41: Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393711.847689:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:3.0:1785393711.848249:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393711.857558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393711.857749:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164288 00000100:00100000:3.0:1785393711.857758:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164288 00000100:00100000:3.0:1785393711.857809:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1785393711.857818:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164288:12345-192.168.203.12@tcp:40: 00000100:00100000:3.0:1785393711.857890:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164288:12345-192.168.203.12@tcp:40: Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393711.857896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1785393711.864792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393711.864826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393711.864852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393711.864887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393711.864916:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164416 00000100:00100000:2.0:1785393711.864924:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164416 00000100:00100000:2.0:1785393711.864954:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164544 00000100:00100000:2.0:1785393711.864956:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164544 00000100:00100000:2.0:1785393711.864967:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1785393711.864974:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1872120807164416:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1785393711.865002:0:6632:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1785393711.865029:0:6632:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b36299a3 00002000:00100000:2.0:1785393711.865041:0:6632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93abc125c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785393711.865062:0:6632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785393711.865370:0:6632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785393711.865397:0:6632:0:(import.c:65:import_set_state_nolock()) ffff93abc125f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785393711.865618:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164800 00000100:00100000:0.0:1785393711.865623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164800 00000100:00100000:0.0:1785393711.865652:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1785393711.865660:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807164800:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1785393711.865715:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807164800:12345-192.168.203.12@tcp:400: Request processed in 56us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393711.865722:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1785393711.865939:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807164416:12345-192.168.203.12@tcp:8: Request processed in 964us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393711.865946:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1785393711.865961:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1785393711.865966:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1872120807164544:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1785393711.865981:0:6632:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1785393711.865996:0:6632:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b36299aa 00002000:00100000:2.0:1785393711.866001:0:6632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93abc125a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785393711.866016:0:6632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785393711.866208:0:6632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785393711.866221:0:6632:0:(import.c:65:import_set_state_nolock()) ffff93abc1259800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785393711.866245:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807164544:12345-192.168.203.12@tcp:8: Request processed in 277us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393711.866252:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1785393711.866688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164672 00000100:00100000:1.0:1785393711.866693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164672 00000100:00100000:1.0:1785393711.866741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785393711.866749:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164672:12345-192.168.203.12@tcp:33: 00000004:00080000:1.0:1785393711.916841:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 50042us 00000004:00200000:0.0:1785393711.939523:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1785393711.939710:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5567:x1872120807164672:12345-192.168.203.12@tcp:33: Request processed in 72948us (74913us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393711.939724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1785393712.159998:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831305728:0@lo:13: 00000100:00100000:2.0:1785393712.160059:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393712.160219:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305728 00000100:00100000:1.0:1785393712.160226:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305728 00000100:00100000:1.0:1785393712.160271:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785393712.160278:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831305728:12345-0@lo:13: 00002000:00000024:1.0:1785393712.160298:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393712.160341:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831305728:12345-0@lo:13: Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393712.160347:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1785393712.160412:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98b100 x1872120831305728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393712.160426:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831305728:0@lo:13: 00000100:00100000:1.0:1785393712.168929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393712.168964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807164928 00000100:00100000:1.0:1785393712.168972:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807164928 00000100:00100000:1.0:1785393712.169022:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1785393712.169031:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5607:x1872120807164928:12345-192.168.203.12@tcp:101: 00010000:00010000:1.0:1785393712.169049:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393712.169114:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b36299b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169174:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169187:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169200:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393712.169364:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1785393712.169369:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393712.169439:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169464:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b36299b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd519 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169481:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd519 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393712.169490:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc3c44b00) 00010000:00010000:1.0:1785393712.169493:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393712.169496:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43e00, rc 0) 00000100:00100000:1.0:1785393712.169542:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:5607:x1872120807164928:12345-192.168.203.12@tcp:101: Request processed in 511us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393712.169549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000001:00100000:1.0:1785393712.208953:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00010000:00010000:0.0:1785393712.223783:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393712.672053:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831305856:0@lo:13: 00000100:00100000:1.0:1785393712.672118:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393712.672255:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305856 00000100:00100000:3.0:1785393712.672261:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305856 00000100:00100000:3.0:1785393712.672308:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785393712.672317:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831305856:12345-0@lo:13: 00002000:00000024:3.0:1785393712.672337:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393712.672391:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831305856:12345-0@lo:13: Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393712.672397:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1785393712.672464:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00212680 x1872120831305856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393712.672500:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831305856:0@lo:13: 00010000:00010000:3.0:1785393713.247793:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393714.276201:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393714.803886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393714.803970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165056 00000100:00100000:0.0:1785393714.803980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165056 00000100:00100000:0.0:1785393714.804048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1785393714.804060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:5659:x1872120807165056:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1785393714.804101:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1785393714.804170:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:5659:x1872120807165056:12345-192.168.203.12@tcp:41: Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393714.804177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:3.0:1785393714.804381:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393714.806703:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393714.806780:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165184 00000100:00100000:3.0:1785393714.806787:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165184 00000100:00100000:3.0:1785393714.806842:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1785393714.806850:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:5659:x1872120807165184:12345-192.168.203.12@tcp:13: 00002000:00000024:3.0:1785393714.806877:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393714.806930:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:5659:x1872120807165184:12345-192.168.203.12@tcp:13: Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393714.806949:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:2.0:1785393714.807010:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393714.808859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393714.808917:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165312 00000100:00100000:3.0:1785393714.808922:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165312 00000100:00100000:3.0:1785393714.808960:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393714.808967:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5659:x1872120807165312:12345-192.168.203.12@tcp:13: 00002000:00000024:3.0:1785393714.808987:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1785393714.809080:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393714.809153:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:5659:x1872120807165312:12345-192.168.203.12@tcp:13: Request processed in 185us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393714.809160:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:0.0:1785393715.296676:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393716.325607:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785393716.336862:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000100:00100000:3.0:1785393716.767835:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831306368:0@lo:400: 00000100:00100000:3.0:1785393716.767913:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393716.767983:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393716.767988:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831306240:0@lo:400: 00000100:00100000:3.0:1785393716.768009:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393716.768036:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306368 00000100:00100000:3.0:1785393716.768042:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306368 00000100:00100000:3.0:1785393716.768092:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785393716.768101:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831306368:12345-0@lo:400: 00000100:00100000:3.0:1785393716.768150:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831306368:12345-0@lo:400: Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393716.768158:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1785393716.768198:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00213800 x1872120831306368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393716.768212:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831306368:0@lo:400: 00000100:00100000:1.0:1785393716.768295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306240 00000100:00100000:1.0:1785393716.768299:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306240 00000100:00100000:1.0:1785393716.768332:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785393716.768338:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831306240:12345-0@lo:400: 00000100:00100000:1.0:1785393716.768375:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831306240:12345-0@lo:400: Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393716.768381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785393716.768430:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831306240:0@lo:400: 00000100:00100000:0.0:1785393716.768601:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831305984:0@lo:400: 00000100:00100000:0.0:1785393716.768632:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393716.768662:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831306496:0@lo:400: 00000100:00100000:0.0:1785393716.768681:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393716.768695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785393716.768699:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831306112:0@lo:400: 00000100:00100000:0.0:1785393716.768713:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393716.768722:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831306624:0@lo:400: 00000100:00100000:0.0:1785393716.768736:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393716.768790:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831305984 00000100:00100000:1.0:1785393716.768794:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831305984 00000100:00100000:1.0:1785393716.768822:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1785393716.768828:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831305984:12345-0@lo:400: 00000100:00100000:1.0:1785393716.768861:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831305984:12345-0@lo:400: Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393716.768867:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1785393716.768888:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306496 00000100:00100000:1.0:1785393716.768891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306496 00000100:00100000:1.0:1785393716.768904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306112 00000100:00100000:1.0:1785393716.768906:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306112 00000100:00100000:1.0:1785393716.768916:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785393716.768921:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831306496:12345-0@lo:400: 00000100:00100000:1.0:1785393716.768943:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831306496:12345-0@lo:400: Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393716.768948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785393716.768965:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785393716.768969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831306112:12345-0@lo:400: 00000100:00100000:1.0:1785393716.768990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831306112:12345-0@lo:400: Request processed in 21us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393716.768995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785393716.769018:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831306112:0@lo:400: 00000100:00100000:1.0:1785393716.769025:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831305984:0@lo:400: 00000100:00100000:1.0:1785393716.769033:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831306496:0@lo:400: 00000100:00080000:2.0:1785393716.770177:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393716.770183:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393716.770194:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306624 00000100:00100000:2.0:1785393716.770199:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306624 00000100:00100000:2.0:1785393716.770242:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785393716.770249:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831306624:12345-0@lo:400: 00000100:00100000:2.0:1785393716.770289:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831306624:12345-0@lo:400: Request processed in 41us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393716.770295:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1785393716.770484:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00210e00 x1872120831306624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393716.770495:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831306624:0@lo:400: 00000100:00080000:3.0:1785393716.772677:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1785393716.930151:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000100:00100000:0.0:1785393716.939298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393716.939345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393716.939491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393716.939527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393716.939653:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165696 00000100:00100000:3.0:1785393716.939662:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165696 00000100:00100000:3.0:1785393716.939729:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165824 00000100:00100000:3.0:1785393716.939732:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165824 00000100:00100000:3.0:1785393716.939750:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393716.939759:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807165696:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1785393716.939822:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807165696:12345-192.168.203.12@tcp:400: Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393716.939830:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393716.939845:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785393716.939851:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807165824:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1785393716.939872:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807165824:12345-192.168.203.12@tcp:400: Request processed in 22us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393716.939877:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1785393716.940000:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165568 00000100:00100000:1.0:1785393716.940005:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165568 00000100:00100000:1.0:1785393716.940035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1785393716.940041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807165568:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1785393716.940069:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807165568:12345-192.168.203.12@tcp:400: Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393716.940074:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00080000:0.0:1785393716.940129:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393716.940133:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393716.940135:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393716.940184:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165440 00000100:00100000:2.0:1785393716.940189:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165440 00000100:00100000:2.0:1785393716.940223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1785393716.940230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807165440:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1785393716.940257:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807165440:12345-192.168.203.12@tcp:400: Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393716.940263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1785393717.279679:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393717.279753:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831306752:0@lo:13: 00000100:00100000:2.0:1785393717.279869:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393717.279929:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306752 00000100:00100000:2.0:1785393717.279937:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306752 00000100:00100000:2.0:1785393717.279976:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785393717.279985:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831306752:12345-0@lo:13: 00002000:00000024:2.0:1785393717.280017:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393717.280057:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831306752:12345-0@lo:13: Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393717.280064:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1785393717.280097:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889fb80 x1872120831306752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393717.280123:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831306752:0@lo:13: 00010000:00010000:3.0:1785393717.343768:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393717.792327:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393717.792349:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831306880:0@lo:13: 00000100:00100000:1.0:1785393717.792435:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393717.792502:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831306880 00000100:00100000:3.0:1785393717.792509:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831306880 00000100:00100000:3.0:1785393717.792560:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785393717.792586:0:6634:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1785393717.792595:0:6634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1785393717.792597:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831306880:12345-0@lo:13: 00002000:00000024:3.0:1785393717.792630:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393717.792701:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831306880:12345-0@lo:13: Request processed in 133us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393717.792708:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1785393717.792732:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab3480 x1872120831306880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393717.792751:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831306880:0@lo:13: 00000001:02000400:2.0:1785393718.035398:0:8189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1785393718.367839:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393719.392736:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393720.424448:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393721.447726:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393721.888567:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831307264:0@lo:400: 00000100:00100000:2.0:1785393721.888685:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393721.888733:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393721.888739:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831307392:0@lo:400: 00000100:00100000:2.0:1785393721.888760:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393721.889486:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831307136:0@lo:400: 00000100:00100000:3.0:1785393721.889530:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393721.889561:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831307648:0@lo:400: 00000100:00100000:3.0:1785393721.889611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393721.889639:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785393721.889644:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831307008:0@lo:400: 00000100:00100000:3.0:1785393721.889668:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393721.889688:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831307520:0@lo:400: 00000100:00100000:3.0:1785393721.889704:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393721.889727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307264 00000100:00100000:3.0:1785393721.889733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307264 00000100:00100000:3.0:1785393721.889779:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307136 00000100:00100000:3.0:1785393721.889782:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307136 00000100:00100000:3.0:1785393721.889790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307520 00000100:00100000:3.0:1785393721.889792:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307520 00000100:00100000:3.0:1785393721.889819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785393721.889826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831307264:12345-0@lo:400: 00000100:00100000:3.0:1785393721.889870:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831307264:12345-0@lo:400: Request processed in 44us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.889876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785393721.889891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785393721.889896:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831307136:12345-0@lo:400: 00000100:00100000:3.0:1785393721.889920:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831307136:12345-0@lo:400: Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.889924:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785393721.889933:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785393721.889946:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831307520:12345-0@lo:400: 00000100:00100000:3.0:1785393721.889970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831307520:12345-0@lo:400: Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.889974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785393721.889989:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307392 00000100:00100000:3.0:1785393721.889992:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307392 00000100:00100000:3.0:1785393721.890016:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307648 00000100:00100000:3.0:1785393721.890018:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307648 00000100:00100000:3.0:1785393721.890029:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393721.890034:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831307392:12345-0@lo:400: 00000100:00100000:3.0:1785393721.890062:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831307392:12345-0@lo:400: Request processed in 27us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.890068:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393721.890078:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393721.890083:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831307648:12345-0@lo:400: 00000100:00100000:3.0:1785393721.890104:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831307648:12345-0@lo:400: Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.890109:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393721.890138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307008 00000100:00100000:3.0:1785393721.890141:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307008 00000100:00100000:3.0:1785393721.890161:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1785393721.890166:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831307008:12345-0@lo:400: 00000100:00100000:3.0:1785393721.890190:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831307008:12345-0@lo:400: Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393721.890195:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1785393721.890216:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393721.890219:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393721.890226:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785393721.890256:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7acbb80 x1872120831307392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393721.890268:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831307392:0@lo:400: 00000100:00100000:3.0:1785393721.890277:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831307264:0@lo:400: 00000100:00100000:3.0:1785393721.890301:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831307008:0@lo:400: 00000100:00100000:3.0:1785393721.890308:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831307520:0@lo:400: 00000100:00100000:3.0:1785393721.890316:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831307136:0@lo:400: 00010000:00080000:3.0:1785393721.890324:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98f100 x1872120831307648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393721.890345:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831307648:0@lo:400: 00000100:00100000:0.0:1785393722.053314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393722.053355:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393722.053383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393722.053412:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393722.053440:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166208 00000100:00100000:0.0:1785393722.053449:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166208 00000100:00100000:0.0:1785393722.053501:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166336 00000100:00100000:0.0:1785393722.053503:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166336 00000100:00100000:0.0:1785393722.053533:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1785393722.053542:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807166208:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1785393722.053720:0:6631:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1785393722.053728:0:6631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1785393722.053839:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807165952 00000100:00100000:1.0:1785393722.053844:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807165952 00000100:00100000:1.0:1785393722.053871:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1785393722.053877:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807165952:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1785393722.058488:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807165952:12345-192.168.203.12@tcp:400: Request processed in 4602us (5183us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393722.058499:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1785393722.063475:0:6630:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1785393722.063502:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1785393722.063528:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807166336:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1785393722.064619:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807166336:12345-192.168.203.12@tcp:400: Request processed in 1095us (11203us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393722.064628:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00080000:1.0:1785393722.064649:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393722.064654:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393722.064663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166080 00000100:00100000:1.0:1785393722.064670:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166080 00000100:00100000:1.0:1785393722.064707:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1785393722.064714:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807166080:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1785393722.064741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807166080:12345-192.168.203.12@tcp:400: Request processed in 27us (11357us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393722.064746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00080000:1.0:1785393722.064760:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393722.071755:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807166208:12345-192.168.203.12@tcp:400: Request processed in 18204us (18389us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393722.071768:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1785393722.407652:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831307776:0@lo:13: 00000100:00100000:0.0:1785393722.407719:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393722.407784:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831307776 00000100:00100000:0.0:1785393722.407791:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831307776 00000100:00100000:0.0:1785393722.407829:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785393722.407837:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831307776:12345-0@lo:13: 00002000:00000024:0.0:1785393722.407867:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393722.407905:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831307776:12345-0@lo:13: Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393722.407924:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1785393722.407962:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98a300 x1872120831307776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393722.407979:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831307776:0@lo:13: 00010000:00010000:3.0:1785393722.468457:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785393722.830132:0:8337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd04848be0 20000000:00000080:3.0:1785393722.830147:0:8337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acc8402000 uarg=0000000000000000 20000000:01000000:3.0:1785393722.830180:0:8337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1785393722.830182:0:8337:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1785393722.830184:0:8337:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1785393722.830189:0:8337:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1785393722.830194:0:8337:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1785393722.830205:0:8337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1785393722.830207:0:8337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1785393722.830389:0:8337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785393722.830392:0:8337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1785393722.838887:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1785393722.839349:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1785393722.839400:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1785393722.839465:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1785393722.839479:0:8337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785393722.839482:0:8337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785393722.843985:0:8339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1785393722.844449:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1785393722.844498:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1785393722.844544:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1785393722.844556:0:8337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1785393722.844565:0:8337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1785393722.845878:0:8340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1785393722.857319:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1785393722.857389:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1785393722.857429:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1785393722.857448:0:8337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1785393722.857451:0:8337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1785393722.860937:0:8341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1785393722.861338:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1785393722.861399:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1785393722.861438:0:8337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1785393722.861455:0:8337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1785393722.861473:0:8337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861489:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861496:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861512:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861526:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861532:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861537:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861543:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861550:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861566:0:8337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861597:0:8337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861633:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861647:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 9 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861662:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831307904:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393722.861746:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861754:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861761:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308032:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393722.861783:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861790:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 18 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861797:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308160:0@lo:104: 00000100:00100000:1.0:1785393722.861827:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785393722.861866:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861873:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 18 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861880:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308288:0@lo:104: 00000100:00100000:1.0:1785393722.861899:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785393722.861919:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861925:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 18 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861931:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308416:0@lo:104: 00010000:00010000:1.0:1785393722.861949:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861955:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 18 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861961:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308544:0@lo:104: 00010000:00010000:1.0:1785393722.861975:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.861981:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 18 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.861987:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308672:0@lo:104: 00010000:00010000:1.0:1785393722.862001:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.862014:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 18 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.862021:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308800:0@lo:104: 00010000:00010000:1.0:1785393722.862039:0:8337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.862046:0:8337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 18 pid: 5826 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.862053:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308928:0@lo:104: 00000100:00100000:1.0:1785393722.862068:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393722.862140:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785393722.862156:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.862167:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.862174:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.862180:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.862187:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.862193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308160 00000100:00100000:3.0:1785393722.862198:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308160 00000100:00100000:3.0:1785393722.862225:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308288 00000100:00100000:3.0:1785393722.862227:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308288 00000100:00100000:3.0:1785393722.862235:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308416 00000100:00100000:3.0:1785393722.862237:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308416 00000100:00100000:3.0:1785393722.862244:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308544 00000100:00100000:3.0:1785393722.862246:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308544 00000100:00100000:3.0:1785393722.862252:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308672 00000100:00100000:3.0:1785393722.862254:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308672 00000100:00100000:3.0:1785393722.862260:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308800 00000100:00100000:3.0:1785393722.862261:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308800 00000100:00100000:3.0:1785393722.862269:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831308928 00000100:00100000:3.0:1785393722.862271:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831308928 00000100:00100000:3.0:1785393722.862280:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393722.862286:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:8337:x1872120831308160:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862297:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862353:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785393722.862358:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+9:8337:x1872120831308160:12345-0@lo:104: Request processed in 72us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862363:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393722.862384:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393722.862390:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+8:8337:x1872120831308288:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862397:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862432:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785393722.862437:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+8:8337:x1872120831308288:12345-0@lo:104: Request processed in 48us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862442:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393722.862468:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785393722.862474:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:8337:x1872120831308416:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862481:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862524:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785393722.862529:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+7:8337:x1872120831308416:12345-0@lo:104: Request processed in 55us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862534:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785393722.862546:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393722.862552:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:8337:x1872120831308544:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862559:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862609:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1785393722.862614:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+6:8337:x1872120831308544:12345-0@lo:104: Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862620:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393722.862639:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393722.862645:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:8337:x1872120831308672:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862652:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862681:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1785393722.862686:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:8337:x1872120831308672:12345-0@lo:104: Request processed in 42us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862691:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393722.862703:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785393722.862708:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:8337:x1872120831308800:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862715:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862737:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1785393722.862741:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:8337:x1872120831308800:12345-0@lo:104: Request processed in 34us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862746:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785393722.862755:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785393722.862760:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:8337:x1872120831308928:12345-0@lo:104: 00010000:00010000:3.0:1785393722.862766:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862785:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1785393722.862789:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:8337:x1872120831308928:12345-0@lo:104: Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.862794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1785393722.862814:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1785393722.862819:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862826:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044a00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.862830:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862838:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.862845:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.862850:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.862871:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862876:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.862891:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862897:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0044a00/0xcc9b96d8b362996b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629972 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862908:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785393722.862911:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862916:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.862919:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862931:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.862937:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.862942:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.862952:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862957:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.862968:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862974:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0045e00/0xcc9b96d8b3629941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629948 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862983:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785393722.862986:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.862992:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.862994:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863000:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.863006:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.863016:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.863027:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863033:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.863037:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863043:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace2d42600/0xcc9b96d8b3629925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362992c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863051:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785393722.863054:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863059:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.863062:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863068:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.863074:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.863079:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.863087:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863091:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.863101:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863106:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b3629917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362991e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863113:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785393722.863116:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863121:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152a200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.863124:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863130:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.863135:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.863140:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.863150:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863155:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.863158:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863164:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152a200/0xcc9b96d8b3629909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629910 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863171:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785393722.863178:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863184:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.863186:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863192:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.863198:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.863202:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.863212:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863216:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.863220:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863225:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc0030600/0xcc9b96d8b36298df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298e6 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863233:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393722.863236:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863241:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393722.863244:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863257:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393722.863263:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393722.863268:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785393722.863278:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863282:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393722.863286:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863292:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc0030200/0xcc9b96d8b36298b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298bc expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863303:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393722.863305:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393722.863306:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393722.863313:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393722.863323:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309056:0@lo:103: 00000100:00100000:3.0:1785393722.863350:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863375:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309568:0@lo:103: 00000100:00100000:3.0:1785393722.863394:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863414:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393722.863420:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309440:0@lo:103: 00000100:00100000:3.0:1785393722.863438:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863470:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309184:0@lo:103: 00000100:00100000:3.0:1785393722.863493:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863521:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309696:0@lo:103: 00000100:00100000:3.0:1785393722.863538:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863549:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1785393722.863553:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309312:0@lo:103: 00000100:00100000:3.0:1785393722.863567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863603:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309824:0@lo:103: 00000100:00100000:3.0:1785393722.863625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393722.863647:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309056 00000100:00100000:3.0:1785393722.863651:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309056 00010000:00010000:3.0:1785393722.863668:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 19 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863684:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309568 00000100:00100000:3.0:1785393722.863687:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309568 00010000:00010000:3.0:1785393722.863699:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 20 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863709:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309440 00000100:00100000:3.0:1785393722.863711:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309440 00010000:00010000:3.0:1785393722.863718:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 21 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863727:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309184 00000100:00100000:3.0:1785393722.863729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309184 00010000:00010000:3.0:1785393722.863736:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863745:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309696 00000100:00100000:3.0:1785393722.863752:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309696 00010000:00010000:3.0:1785393722.863763:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 23 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863773:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309312 00000100:00100000:3.0:1785393722.863775:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309312 00010000:00010000:3.0:1785393722.863782:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 24 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863790:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309824 00000100:00100000:3.0:1785393722.863793:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309824 00010000:00010000:3.0:1785393722.863800:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 25 pid: 5826 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.863811:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393722.863816:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+25:3318:x1872120831309056:12345-0@lo:103: 00010000:00010000:3.0:1785393722.863825:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.863830:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 25 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863839:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 25 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863852:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.863880:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+25:3318:x1872120831309056:12345-0@lo:103: Request processed in 63us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.863887:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393722.863898:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393722.863904:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+24:3318:x1872120831309568:12345-0@lo:103: 00010000:00010000:3.0:1785393722.863910:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.863920:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 24 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863928:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 24 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863938:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.863958:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+24:3318:x1872120831309568:12345-0@lo:103: Request processed in 55us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.863964:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393722.863975:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785393722.863981:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+23:3318:x1872120831309440:12345-0@lo:103: 00010000:00010000:3.0:1785393722.863987:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.863991:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 23 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.863999:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 23 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864007:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.864024:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+23:3318:x1872120831309440:12345-0@lo:103: Request processed in 43us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.864029:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785393722.864039:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393722.864044:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+22:3315:x1872120831309184:12345-0@lo:103: 00010000:00010000:3.0:1785393722.864050:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.864054:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864072:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 22 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864081:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.864104:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+22:3315:x1872120831309184:12345-0@lo:103: Request processed in 60us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.864111:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785393722.864121:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393722.864127:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3315:x1872120831309696:12345-0@lo:103: 00010000:00010000:3.0:1785393722.864133:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.864138:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 21 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864146:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 21 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864154:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.864172:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3315:x1872120831309696:12345-0@lo:103: Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.864177:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785393722.864186:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785393722.864191:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3315:x1872120831309312:12345-0@lo:103: 00010000:00010000:3.0:1785393722.864198:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.864201:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 20 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864208:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 20 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864223:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.864245:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3315:x1872120831309312:12345-0@lo:103: Request processed in 53us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.864251:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785393722.864262:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785393722.864267:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd8efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831309824:12345-0@lo:103: 00010000:00010000:3.0:1785393722.864274:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.864278:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 19 pid: 5826 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864287:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 19 pid: 5826 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.864296:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.864316:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd8efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831309824:12345-0@lo:103: Request processed in 48us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.864321:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785393722.864373:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309440:0@lo:103: 00000100:00100000:3.0:1785393722.864381:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309056:0@lo:103: 00000100:00100000:3.0:1785393722.864388:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831309568:0@lo:103: 00000100:00100000:3.0:1785393722.864415:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309312:0@lo:103: 00000100:00100000:3.0:1785393722.864422:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309824:0@lo:103: 00000100:00100000:3.0:1785393722.864429:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309184:0@lo:103: 00000100:00100000:3.0:1785393722.864436:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831309696:0@lo:103: 00010000:00010000:1.0:1785393722.864545:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362996b expref: 18 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864556:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308160:0@lo:104: 00010000:00010000:1.0:1785393722.864563:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0045400/0xcc9b96d8b3629948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629941 expref: 17 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864589:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308288:0@lo:104: 00010000:00010000:1.0:1785393722.864599:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031600/0xcc9b96d8b362992c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629925 expref: 16 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864606:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308416:0@lo:104: 00010000:00010000:1.0:1785393722.864614:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0000/0xcc9b96d8b362991e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629917 expref: 15 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864622:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308544:0@lo:104: 00010000:00010000:1.0:1785393722.864640:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629909 expref: 14 pid: 5825 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864648:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308672:0@lo:104: 00010000:00010000:1.0:1785393722.864655:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36298e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36298df expref: 13 pid: 5824 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864662:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308800:0@lo:104: 00010000:00010000:1.0:1785393722.864669:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43c00/0xcc9b96d8b36298bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36298b5 expref: 12 pid: 5826 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.864676:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308928:0@lo:104: 00010000:00010000:0.0:1785393722.865761:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393722.869937:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831307904:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393722.869950:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8337:1872120831308032:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393722.869987:0:8337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393722.889790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393722.889825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393722.889902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166464 00000100:00100000:3.0:1785393722.889910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166464 00010000:00010000:3.0:1785393722.889954:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 10 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.889987:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166592 00000100:00100000:3.0:1785393722.889990:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166592 00010000:00010000:3.0:1785393722.889999:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 11 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393722.890022:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1785393722.890029:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2359:x1872120807166464:12345-192.168.203.12@tcp:103: 00010000:00010000:3.0:1785393722.890042:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.890048:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 11 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890059:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 11 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890075:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43400/0xcc9b96d8b3629987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4be expref: 11 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890089:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.890129:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807166464:12345-192.168.203.12@tcp:103: Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.890135:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1785393722.890148:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1785393722.890153:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:2359:x1872120807166592:12345-192.168.203.12@tcp:103: 00010000:00010000:3.0:1785393722.890175:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393722.890179:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890187:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890196:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b3629980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4b7 expref: 9 pid: 5824 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890206:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890214:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890240:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890246:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890252:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890258:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890263:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393722.890266:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890281:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890293:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393722.890301:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393722.890317:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:2359:x1872120807166592:12345-192.168.203.12@tcp:103: Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393722.890322:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:1.0:1785393722.890626:0:8337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.890635:0:8337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393722.890641:0:8337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43600/0xcc9b96d8b36299bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393722.911789:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831309952:0@lo:13: 00000100:00100000:1.0:1785393722.911857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393722.912420:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831309952 00000100:00100000:0.0:1785393722.912427:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831309952 00000100:00100000:0.0:1785393722.912478:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785393722.912487:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831309952:12345-0@lo:13: 00002000:00000024:0.0:1785393722.912526:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393722.912697:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831309952:12345-0@lo:13: Request processed in 210us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393722.912705:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1785393722.914743:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a6d80 x1872120831309952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393722.914765:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831309952:0@lo:13: 00010000:00010000:3.0:1785393723.488059:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785393724.129531:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1785393724.129538:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc8926000 from 39 10000000:01000000:1.0:1785393724.129543:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785393724.129615:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.129627:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.129638:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393724.129660:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310080:0@lo:101: 00000100:00100000:1.0:1785393724.129722:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.129782:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.129882:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310080 00000100:00100000:3.0:1785393724.129889:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310080 00000100:00100000:3.0:1785393724.129936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1785393724.129944:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+12:5828:x1872120831310080:12345-0@lo:101: 00010000:00010000:3.0:1785393724.129956:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393724.129968:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc152a200/0xcc9b96d8b36299cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36299c6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.129989:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc152a200/0xcc9b96d8b36299cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36299c6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.129998:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc152a200/0xcc9b96d8b36299cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36299c6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.130007:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152a200, rc 0) 00000100:00100000:3.0:1785393724.130061:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310080:12345-0@lo:101: Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.130081:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1785393724.130162:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310080:0@lo:101: 00010000:00010000:0.0:1785393724.130175:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.130183:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393724.130228:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310208:0@lo:501: 00000100:00100000:0.0:1785393724.130251:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.130273:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d780 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.130441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310208 00000100:00100000:3.0:1785393724.130446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310208 00000100:00100000:3.0:1785393724.130467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1785393724.130473:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310208:12345-0@lo:501: 00000100:00100000:3.0:1785393724.130733:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310208:12345-0@lo:501: Request processed in 259us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.130740:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785393724.130802:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310208:0@lo:501: 00000100:00100000:0.0:1785393724.130831:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310336:0@lo:503: 00000100:00100000:0.0:1785393724.130863:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.130886:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d780 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.130937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310336 00000100:00100000:2.0:1785393724.130941:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310336 00000100:00100000:2.0:1785393724.130958:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1785393724.130963:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310336:12345-0@lo:503: 00000100:00100000:2.0:1785393724.131095:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310336:12345-0@lo:503: Request processed in 130us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.131102:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1785393724.131169:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310336:0@lo:503: 00000100:00100000:1.0:1785393724.134659:0:8353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8353:1872120831310464:0@lo:502: 00000100:00100000:1.0:1785393724.134722:0:8353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.134761:0:8353:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.134862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310464 00000100:00100000:2.0:1785393724.134867:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310464 00000100:00100000:2.0:1785393724.134909:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1785393724.134915:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:8353:x1872120831310464:12345-0@lo:502: 00000100:00100000:2.0:1785393724.135107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:8353:x1872120831310464:12345-0@lo:502: Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.135114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785393724.135197:0:8353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8353:1872120831310464:0@lo:502: 00000100:00100000:3.0:1785393724.135234:0:8353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8353:1872120831310592:0@lo:502: 00000100:00100000:3.0:1785393724.135262:0:8353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.135297:0:8353:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.136403:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310592 00000100:00100000:1.0:1785393724.136409:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310592 00000100:00100000:1.0:1785393724.136443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1785393724.136451:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:8353:x1872120831310592:12345-0@lo:502: 00000100:00100000:1.0:1785393724.136636:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:8353:x1872120831310592:12345-0@lo:502: Request processed in 185us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.136643:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1785393724.136723:0:8353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8353:1872120831310592:0@lo:502: 00000040:00080000:0.0:1785393724.136745:0:8353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1785393724.136985:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1785393724.137002:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785393724.137010:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.137029:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393724.137037:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1785393724.137039:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1785393724.137042:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1785393724.137064:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.137071:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.137078:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393724.137089:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310720:0@lo:101: 00000100:00100000:1.0:1785393724.137113:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.137139:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.137180:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310720 00000100:00100000:3.0:1785393724.137184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310720 00000100:00100000:3.0:1785393724.137210:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1785393724.137215:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+13:5828:x1872120831310720:12345-0@lo:101: 00010000:00010000:3.0:1785393724.137223:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393724.137233:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc152ba00/0xcc9b96d8b36299db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36299d4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.137249:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc152ba00/0xcc9b96d8b36299db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36299d4 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.137257:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc152ba00/0xcc9b96d8b36299db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36299d4 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.137264:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152ba00, rc 0) 00000100:00100000:3.0:1785393724.137304:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831310720:12345-0@lo:101: Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.137317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1785393724.137504:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310720:0@lo:101: 00010000:00010000:1.0:1785393724.137517:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.137526:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393724.137560:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310848:0@lo:501: 00000100:00100000:1.0:1785393724.137611:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.137641:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.137725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310848 00000100:00100000:3.0:1785393724.137729:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310848 00000100:00100000:3.0:1785393724.137757:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1785393724.137762:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831310848:12345-0@lo:501: 00000100:00100000:3.0:1785393724.137987:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831310848:12345-0@lo:501: Request processed in 224us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.137994:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1785393724.146801:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310848:0@lo:501: 00000100:00100000:2.0:1785393724.146862:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310976:0@lo:503: 00000100:00100000:2.0:1785393724.146927:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.146965:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.147041:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831310976 00000100:00100000:3.0:1785393724.147047:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831310976 00000100:00100000:3.0:1785393724.147091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785393724.147099:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831310976:12345-0@lo:503: 00000100:00100000:3.0:1785393724.147268:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831310976:12345-0@lo:503: Request processed in 169us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.147275:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1785393724.147404:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831310976:0@lo:503: 00000100:00100000:1.0:1785393724.149658:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8354:1872120831311104:0@lo:502: 00000100:00100000:1.0:1785393724.149706:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.149735:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1785393724.149789:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311104 00000100:00100000:0.0:1785393724.149794:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311104 00000100:00100000:0.0:1785393724.149827:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1785393724.149835:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:8354:x1872120831311104:12345-0@lo:502: 00000100:00100000:0.0:1785393724.149999:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:8354:x1872120831311104:12345-0@lo:502: Request processed in 164us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393724.150006:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785393724.150076:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8354:1872120831311104:0@lo:502: 00000020:01000000:1.0:1785393724.150100:0:8354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785393724.150108:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393724.150110:0:8354:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785393724.150116:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1785393724.150133:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8354:1872120831311232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393724.150162:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393724.150182:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf540 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.150230:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311232 00000100:00100000:3.0:1785393724.150234:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311232 00000100:00100000:3.0:1785393724.150262:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785393724.150268:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:8354:x1872120831311232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393724.150600:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:8354:x1872120831311232:12345-0@lo:502:llog_process_th.0 Request processed in 331us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.150607:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1785393724.150697:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8354:1872120831311232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785393724.150714:0:8354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393724.150718:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393724.150719:0:8354:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785393724.150723:0:8354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1785393724.150877:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1785393724.150895:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1785393724.150904:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.150920:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393724.150929:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785393724.150931:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc825e800 from 39 10000000:01000000:3.0:1785393724.150934:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785393724.150955:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.150962:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.150970:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393724.150982:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.151007:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.151069:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0600 going to sleep for 11 seconds 00000100:00100000:0.0:1785393724.161815:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311360 00000100:00100000:0.0:1785393724.161828:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311360 00000100:00100000:0.0:1785393724.161883:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1785393724.161892:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:5828:x1872120831311360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393724.161908:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393724.161924:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0044800/0xcc9b96d8b36299e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36299e2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.161948:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0044800/0xcc9b96d8b36299e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36299e2 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.161960:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0044800/0xcc9b96d8b36299e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36299e2 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.161985:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044800, rc 0) 00000100:00100000:0.0:1785393724.162060:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831311360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (11051us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393724.162066:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1785393724.162216:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393724.162233:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.162243:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.162319:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.162358:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.162391:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.162612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311488 00000100:00100000:1.0:1785393724.162618:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311488 00000100:00100000:1.0:1785393724.162643:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785393724.162649:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831311488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393724.162859:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831311488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.162866:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1785393724.164510:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.164546:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.164625:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.164650:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.164701:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311616 00000100:00100000:1.0:1785393724.164706:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311616 00000100:00100000:1.0:1785393724.164733:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1785393724.164739:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831311616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393724.164880:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831311616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.164886:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1785393724.166547:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831311616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.167793:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8355:1872120831311744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.167850:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.167885:0:8355:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.167930:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311744 00000100:00100000:3.0:1785393724.167935:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311744 00000100:00100000:3.0:1785393724.167969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785393724.167976:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:8355:x1872120831311744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393724.168171:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:8355:x1872120831311744:12345-0@lo:502:llog_process_th.0 Request processed in 195us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.168178:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1785393724.168271:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8355:1872120831311744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.168411:0:8355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8355:1872120831311872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.168447:0:8355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.168467:0:8355:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.169799:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831311872 00000100:00100000:3.0:1785393724.169805:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831311872 00000100:00100000:3.0:1785393724.169838:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785393724.169852:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:8355:x1872120831311872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393724.169996:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:8355:x1872120831311872:12345-0@lo:502:llog_process_th.0 Request processed in 144us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.170002:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1785393724.170071:0:8355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8355:1872120831311872:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1785393724.170093:0:8355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1785393724.170267:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1785393724.170291:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785393724.170299:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.170319:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393724.170332:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1785393724.170335:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1785393724.170337:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1785393724.170358:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.170365:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.170375:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393724.170389:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.170417:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.170456:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.170717:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312000 00000100:00100000:1.0:1785393724.170722:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312000 00000100:00100000:1.0:1785393724.170742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1785393724.170748:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:5828:x1872120831312000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393724.170756:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393724.170767:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36299f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36299f0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.170785:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36299f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36299f0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.170794:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36299f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36299f0 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.170802:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43200, rc 0) 00000100:00100000:1.0:1785393724.170828:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.170834:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1785393724.172501:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393724.172530:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.172539:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393724.172619:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.172651:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.172677:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.172757:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312128 00000100:00100000:1.0:1785393724.172761:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312128 00000100:00100000:1.0:1785393724.172783:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785393724.172795:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393724.172991:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.172998:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785393724.173655:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.173683:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.173714:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.173742:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.173789:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312256 00000100:00100000:2.0:1785393724.173794:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312256 00000100:00100000:2.0:1785393724.173821:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1785393724.173828:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.173956:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.173963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1785393724.174686:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.176559:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8356:1872120831312384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393724.176637:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.176666:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.176721:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312384 00000100:00100000:2.0:1785393724.176727:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312384 00000100:00100000:2.0:1785393724.176768:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1785393724.176776:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:8356:x1872120831312384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.176936:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:8356:x1872120831312384:12345-0@lo:502:llog_process_th.0 Request processed in 160us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.176942:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785393724.177063:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8356:1872120831312384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393724.177087:0:8356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393724.177095:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393724.177098:0:8356:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785393724.177104:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785393724.177124:0:8356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8356:1872120831312512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393724.177155:0:8356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.177172:0:8356:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.177216:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312512 00000100:00100000:2.0:1785393724.177220:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312512 00000100:00100000:2.0:1785393724.177247:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785393724.177253:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:8356:x1872120831312512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.177390:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:8356:x1872120831312512:12345-0@lo:502:llog_process_th.0 Request processed in 137us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.177403:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1785393724.177618:0:8356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8356:1872120831312512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393724.177636:0:8356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393724.177641:0:8356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393724.177642:0:8356:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785393724.177646:0:8356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1785393724.177782:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1785393724.177797:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785393724.177806:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.177816:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393724.177825:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785393724.177834:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ace0136800 from 39 10000000:01000000:3.0:1785393724.177837:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785393724.177858:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.177865:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.177872:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393724.177884:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.177910:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.177929:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.182561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312640 00000100:00100000:2.0:1785393724.182609:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312640 00000100:00100000:2.0:1785393724.182661:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1785393724.182670:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831312640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393724.182684:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393724.182700:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0a00/0xcc9b96d8b3629a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b36299fe expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.182725:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0a00/0xcc9b96d8b3629a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b36299fe expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.182735:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0a00/0xcc9b96d8b3629a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36299fe expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.182744:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0a00, rc 0) 00000100:00100000:2.0:1785393724.182807:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831312640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.182813:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1785393724.182921:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393724.182940:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.182949:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393724.183008:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.183053:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.183077:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.183130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312768 00000100:00100000:3.0:1785393724.183134:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312768 00000100:00100000:3.0:1785393724.183163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1785393724.183169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831312768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.183414:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831312768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.183420:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1785393724.183624:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.183647:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.183679:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.183693:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.183845:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831312896 00000100:00100000:2.0:1785393724.183849:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831312896 00000100:00100000:2.0:1785393724.183875:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1785393724.183881:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831312896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.184001:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831312896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.184007:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1785393724.184072:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831312896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.184477:0:8357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8357:1872120831313024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393724.184517:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.184534:0:8357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.184591:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313024 00000100:00100000:2.0:1785393724.184600:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313024 00000100:00100000:2.0:1785393724.184620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785393724.184625:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8357:x1872120831313024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.184751:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8357:x1872120831313024:12345-0@lo:502:llog_process_th.0 Request processed in 125us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.184757:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785393724.184786:0:8357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8357:1872120831313024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.184816:0:8357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8357:1872120831313152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.184841:0:8357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.184856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313152 00000100:00100000:2.0:1785393724.184858:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313152 00000100:00100000:2.0:1785393724.184872:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1785393724.184876:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8357:x1872120831313152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.184983:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8357:x1872120831313152:12345-0@lo:502:llog_process_th.0 Request processed in 106us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.184990:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1785393724.185015:0:8357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.185026:0:8357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8357:1872120831313152:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1785393724.185043:0:8357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1785393724.185087:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1785393724.185102:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785393724.185109:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185118:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393724.185137:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1785393724.185140:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1785393724.185143:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785393724.185162:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185170:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185178:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.185190:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.185214:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.185227:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.185238:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313280 00000100:00100000:2.0:1785393724.185241:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313280 00000100:00100000:2.0:1785393724.185259:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785393724.185265:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831313280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393724.185273:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393724.185281:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b3629a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a0c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185310:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b3629a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a0c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185522:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b3629a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a0c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.185539:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1000, rc 0) 00000100:00100000:2.0:1785393724.185677:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831313280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 411us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.185683:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1785393724.192751:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393724.192776:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.192789:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.194746:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.194802:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.194834:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1785393724.195855:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313408 00000100:00100000:0.0:1785393724.195862:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313408 00000100:00100000:0.0:1785393724.195899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1785393724.195907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831313408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.196146:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831313408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.196223:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.196253:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.196289:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.196330:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.196415:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313536 00000100:00100000:3.0:1785393724.196420:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313536 00000100:00100000:3.0:1785393724.196448:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1785393724.196456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831313536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393724.196622:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831313536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.196629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785393724.196802:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.197405:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1785393724.197547:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8358:1872120831313664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393724.197610:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393724.197640:0:8358:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.197722:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313664 00000100:00100000:2.0:1785393724.197726:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313664 00000100:00100000:2.0:1785393724.197756:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1785393724.197762:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8358:x1872120831313664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.197917:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8358:x1872120831313664:12345-0@lo:502:llog_process_th.0 Request processed in 154us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.197924:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1785393724.198457:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8358:1872120831313664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393724.198486:0:8358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393724.198506:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393724.198509:0:8358:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785393724.198515:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785393724.198536:0:8358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8358:1872120831313792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393724.198602:0:8358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393724.198636:0:8358:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99db40 going to sleep for 11 seconds 00000100:00100000:2.0:1785393724.198912:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313792 00000100:00100000:2.0:1785393724.198917:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313792 00000100:00100000:2.0:1785393724.198944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1785393724.198952:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8358:x1872120831313792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393724.199097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8358:x1872120831313792:12345-0@lo:502:llog_process_th.0 Request processed in 145us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393724.199113:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1785393724.199221:0:8358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8358:1872120831313792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785393724.199239:0:8358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393724.199243:0:8358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393724.199245:0:8358:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785393724.199249:0:8358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1785393724.199639:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1785393724.199657:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1785393724.199667:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.199677:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393724.199686:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1785393724.199689:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93acc9538000 from 1 10000000:01000000:2.0:1785393724.199692:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785393724.199716:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.199725:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.199733:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.199747:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.199773:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.199843:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8cdb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393724.207616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831313920 00000100:00100000:3.0:1785393724.207629:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831313920 00000100:00100000:3.0:1785393724.207689:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1785393724.207698:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831313920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393724.207715:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393724.207731:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc152a000/0xcc9b96d8b3629a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a1a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.207757:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc152a000/0xcc9b96d8b3629a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a1a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.207769:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc152a000/0xcc9b96d8b3629a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a1a expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393724.207778:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152a000, rc 0) 00000100:00100000:3.0:1785393724.207851:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831313920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (8077us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.207857:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1785393724.208053:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831313920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393724.208070:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.208097:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.208156:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831314048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785393724.208187:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393724.208223:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8cdb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393724.208263:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314048 00000100:00100000:1.0:1785393724.208267:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314048 00000100:00100000:1.0:1785393724.208298:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1785393724.208305:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831314048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393724.208531:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831314048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (342us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785393724.208539:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1785393724.208659:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831314048:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1785393724.208680:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1785393724.208686:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393724.208694:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393724.230169:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393724.230249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166720 00000100:00100000:0.0:1785393724.230258:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166720 00000100:00100000:0.0:1785393724.230319:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1785393724.230334:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:5582:x1872120807166720:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1785393724.230351:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393724.230368:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0045a00/0xcc9b96d8b3629a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd520 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.230395:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0045a00/0xcc9b96d8b3629a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd520 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.230407:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0045a00/0xcc9b96d8b3629a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd520 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393724.230417:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045a00, rc 0) 00000100:00100000:0.0:1785393724.230466:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807166720:12345-192.168.203.12@tcp:101: Request processed in 139us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393724.230473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1785393724.234409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393724.234611:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166848 00000100:00100000:3.0:1785393724.234619:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166848 00000100:00100000:3.0:1785393724.234669:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1785393724.234677:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807166848:12345-192.168.203.12@tcp:501: 00000100:00100000:3.0:1785393724.234961:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807166848:12345-192.168.203.12@tcp:501: Request processed in 283us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.234968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1785393724.253067:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393724.253175:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807166976 00000100:00100000:1.0:1785393724.253184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807166976 00000100:00100000:1.0:1785393724.253236:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:1.0:1785393724.253245:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807166976:12345-192.168.203.12@tcp:503: 00000100:00100000:1.0:1785393724.253470:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807166976:12345-192.168.203.12@tcp:503: Request processed in 225us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.253478:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1785393724.257291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393724.257372:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167104 00000100:00100000:0.0:1785393724.257380:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167104 00000100:00100000:0.0:1785393724.257430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:0.0:1785393724.257439:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:6052:x1872120807167104:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1785393724.257702:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:6052:x1872120807167104:12345-192.168.203.12@tcp:502: Request processed in 263us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393724.257709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:0.0:1785393724.260614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393724.260944:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167232 00000100:00100000:3.0:1785393724.260951:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167232 00000100:00100000:3.0:1785393724.260990:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:3.0:1785393724.260997:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:6052:x1872120807167232:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785393724.261210:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:6052:x1872120807167232:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 212us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393724.261217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:3.0:1785393724.271989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393724.272059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167360 00000100:00100000:1.0:1785393724.272079:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167360 00000100:00100000:1.0:1785393724.272125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1785393724.272133:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807167360:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393724.272150:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393724.272166:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd527 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.272191:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd527 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.272201:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd527 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393724.272209:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42200, rc 0) 00000100:00100000:1.0:1785393724.272257:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807167360:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393724.272263:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:2.0:1785393724.273941:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393724.274003:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167488 00000100:00100000:0.0:1785393724.274009:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167488 00000100:00100000:0.0:1785393724.274041:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:0.0:1785393724.274048:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807167488:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393724.274254:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807167488:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 205us (315us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785393724.274262:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00010000:00010000:3.0:1785393724.519558:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785393725.416509:0:8396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7e406c30 20000000:00000080:1.0:1785393725.416524:0:8396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acc8402000 uarg=0000000000000000 20000000:01000000:1.0:1785393725.416555:0:8396:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785393725.416560:0:8396:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785393725.416564:0:8396:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1785393725.417370:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1785393725.417502:0:8396:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1785393725.425776:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1785393725.425818:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1785393725.425861:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1785393725.425876:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1785393725.425907:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.425933:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.425939:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.425945:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.425952:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426041:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426078:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426092:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 9 pid: 5825 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.426106:0:8396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314176:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393725.426224:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426231:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 18 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.426239:0:8396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314304:0@lo:104: 00000100:00100000:1.0:1785393725.426287:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785393725.426401:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426409:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 18 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.426416:0:8396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314432:0@lo:104: 00000100:00100000:1.0:1785393725.426443:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785393725.426467:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.426477:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 18 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.426494:0:8396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314560:0@lo:104: 00000100:00100000:1.0:1785393725.426510:0:8396:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc84bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393725.426661:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785393725.426743:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393725.426767:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314304 00000100:00100000:2.0:1785393725.426787:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314304 00000100:00100000:2.0:1785393725.426817:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314432 00000100:00100000:2.0:1785393725.426825:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314432 00000100:00100000:2.0:1785393725.426833:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314560 00000100:00100000:2.0:1785393725.426835:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314560 00000100:00100000:2.0:1785393725.426845:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785393725.426851:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:8396:x1872120831314304:12345-0@lo:104: 00010000:00010000:2.0:1785393725.426862:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.426980:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785393725.427000:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:8396:x1872120831314304:12345-0@lo:104: Request processed in 149us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.427006:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785393725.427021:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785393725.427030:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:8396:x1872120831314432:12345-0@lo:104: 00010000:00010000:2.0:1785393725.427037:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427077:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785393725.427085:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:8396:x1872120831314432:12345-0@lo:104: Request processed in 55us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.427089:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785393725.427112:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785393725.427129:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:8396:x1872120831314560:12345-0@lo:104: 00010000:00010000:2.0:1785393725.427135:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427158:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785393725.427176:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:8396:x1872120831314560:12345-0@lo:104: Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.427181:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1785393725.427193:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785393725.427198:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427204:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42e00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393725.427212:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427220:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393725.427227:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393725.427232:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393725.427253:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427257:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393725.427271:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427278:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace2d42e00/0xcc9b96d8b36298d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36298d8 expref: -99 pid: 7516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427292:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785393725.427295:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427300:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cc800 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393725.427303:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427310:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393725.427326:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393725.427342:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393725.427356:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427361:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393725.427374:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427381:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cc800/0xcc9b96d8b3629806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362980d expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427391:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393725.427394:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427399:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cdc00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393725.427402:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427409:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393725.427414:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393725.427419:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393725.427436:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427443:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393725.427448:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427453:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cdc00/0xcc9b96d8b36297a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b36297ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427464:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393725.427466:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393725.427468:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393725.427496:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831314688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393725.427522:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393725.427552:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831314944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393725.427598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393725.427615:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393725.427635:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831314816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393725.427667:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393725.427687:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314688 00000100:00100000:2.0:1785393725.427706:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314688 00010000:00010000:2.0:1785393725.427720:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 19 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393725.427749:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314944 00000100:00100000:2.0:1785393725.427751:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314944 00010000:00010000:2.0:1785393725.427759:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 20 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393725.427777:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831314816 00000100:00100000:2.0:1785393725.427779:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831314816 00010000:00010000:2.0:1785393725.427787:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 21 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393725.427796:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785393725.427800:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3318:x1872120831314688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393725.427808:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393725.427812:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 21 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427819:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 21 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427831:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393725.427867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3318:x1872120831314688:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.427875:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785393725.427886:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393725.427892:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3316:x1872120831314944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393725.427899:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393725.427903:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 20 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427910:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 20 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427919:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393725.427948:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3316:x1872120831314944:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.427953:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393725.427964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393725.427969:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831314816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393725.427975:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393725.427979:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 19 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427986:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 19 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.427993:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393725.428008:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831314816:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393725.428012:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393725.428060:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831314688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393725.428091:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831314816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393725.428097:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831314944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785393725.430691:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152be00/0xcc9b96d8b36298d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36298d1 expref: 18 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.430709:0:8396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314304:0@lo:104: 00010000:00010000:1.0:1785393725.430720:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b362980d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629806 expref: 17 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.430727:0:8396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314432:0@lo:104: 00010000:00010000:1.0:1785393725.430735:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152ac00/0xcc9b96d8b36297ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b36297a4 expref: 16 pid: 5826 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.430743:0:8396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314560:0@lo:104: 00010000:00010000:3.0:1785393725.431047:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393725.431787:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393725.434736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393725.434821:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167616 00000100:00100000:3.0:1785393725.434830:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167616 00010000:00010000:3.0:1785393725.434863:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 10 pid: 5825 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393725.434896:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1785393725.434905:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807167616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393725.434919:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393725.434926:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 10 pid: 5825 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.434937:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 10 pid: 5825 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.434963:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.434983:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.434999:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435007:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435013:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435020:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435026:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393725.435030:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435039:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435048:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393725.435059:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393725.435106:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807167616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 202us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393725.435113:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:1.0:1785393725.436751:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0044400/0xcc9b96d8b3629995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4ef expref: 9 pid: 5825 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393725.436769:0:8396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8396:1872120831314176:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393725.436802:0:8396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.436812:0:8396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.436818:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393725.436824:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629a36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393725.537611:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393726.568115:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785393726.883428:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785393726.883434:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc8926000 from 4 10000000:01000000:3.0:1785393726.883439:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785393726.883485:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.883496:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.883507:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393726.883531:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.883604:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393726.883657:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8da5600 going to sleep for 11 seconds 00000100:00100000:1.0:1785393726.883761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315072 00000100:00100000:1.0:1785393726.883768:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315072 00000100:00100000:1.0:1785393726.883814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785393726.883821:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831315072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393726.883833:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393726.883845:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a3d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393726.883866:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393726.883875:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393726.883896:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43000, rc 0) 00000100:00100000:1.0:1785393726.883933:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393726.883939:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785393726.883980:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393726.883993:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393726.884001:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393726.884048:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393726.884071:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393726.884085:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393726.884097:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315200 00000100:00100000:1.0:1785393726.884100:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315200 00000100:00100000:1.0:1785393726.884119:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785393726.884125:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393726.884337:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393726.884344:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785393726.885670:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393726.885701:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393726.885739:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393726.885769:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393726.885879:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315328 00000100:00100000:3.0:1785393726.885883:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315328 00000100:00100000:3.0:1785393726.885911:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1785393726.885917:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.886051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393726.886057:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1785393726.886118:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.894234:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8434:1872120831315456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.894307:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.894346:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393726.896497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315456 00000100:00100000:1.0:1785393726.896508:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315456 00000100:00100000:1.0:1785393726.896564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1785393726.896590:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8434:x1872120831315456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393726.896812:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8434:x1872120831315456:12345-0@lo:502:llog_process_th.0 Request processed in 225us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393726.896819:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1785393726.896960:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8434:1872120831315456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.896990:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393726.896998:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.897001:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785393726.897008:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc8926000 00000020:00000080:0.0:1785393726.897010:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785393726.897082:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8434:1872120831315584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.897116:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.897158:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc69059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393726.897199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315584 00000100:00100000:3.0:1785393726.897203:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315584 00000100:00100000:3.0:1785393726.897231:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1785393726.897236:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8434:x1872120831315584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393726.897366:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:8434:x1872120831315584:12345-0@lo:502:llog_process_th.0 Request processed in 128us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393726.897373:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1785393726.897501:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8434:1872120831315584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.897519:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393726.897523:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.897524:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1785393726.897528:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1785393726.897616:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1785393726.897632:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393726.897640:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.897650:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393726.897658:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785393726.897661:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc825e800 from 4 10000000:01000000:0.0:1785393726.897664:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785393726.897684:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.897693:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.897702:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393726.897714:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.897738:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.897750:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc69059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393726.900444:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315712 00000100:00100000:3.0:1785393726.900454:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315712 00000100:00100000:3.0:1785393726.900499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785393726.900508:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831315712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393726.900520:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393726.900549:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a4b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.900583:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.900593:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.900600:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1e00, rc 0) 00000100:00100000:3.0:1785393726.900661:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831315712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393726.900666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785393726.900724:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393726.900739:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393726.900747:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393726.900798:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.900822:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393726.900839:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eefc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393726.900856:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315840 00000100:00100000:3.0:1785393726.900859:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315840 00000100:00100000:3.0:1785393726.900876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785393726.900880:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831315840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.901063:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831315840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393726.901070:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785393726.901095:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.901117:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.901145:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393726.901158:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eefc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393726.901166:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831315968 00000100:00100000:3.0:1785393726.901169:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831315968 00000100:00100000:3.0:1785393726.901184:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1785393726.901189:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831315968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393726.901296:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831315968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393726.901302:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1785393726.901438:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831315968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.910729:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8436:1872120831316096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.910812:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.910856:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905300 going to sleep for 11 seconds 00000100:00100000:2.0:1785393726.910899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316096 00000100:00100000:2.0:1785393726.910905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316096 00000100:00100000:2.0:1785393726.910949:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1785393726.910958:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8436:x1872120831316096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393726.911156:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8436:x1872120831316096:12345-0@lo:502:llog_process_th.0 Request processed in 199us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393726.911169:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785393726.911434:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8436:1872120831316096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.911460:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393726.911469:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.911471:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785393726.911487:0:8436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc825e800 00000020:00000080:0.0:1785393726.911490:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785393726.911547:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8436:1872120831316224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.911608:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.911624:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905300 going to sleep for 11 seconds 00000100:00100000:2.0:1785393726.911673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316224 00000100:00100000:2.0:1785393726.911678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316224 00000100:00100000:2.0:1785393726.911707:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1785393726.911715:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8436:x1872120831316224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393726.911818:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:8436:x1872120831316224:12345-0@lo:502:llog_process_th.0 Request processed in 104us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393726.911826:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1785393726.911940:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8436:1872120831316224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.911957:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393726.911962:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.911964:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1785393726.911967:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1785393726.912091:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1785393726.912110:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785393726.912118:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393726.912128:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393726.912137:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785393726.912139:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ace0136800 from 4 10000000:01000000:2.0:1785393726.912142:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785393726.912163:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393726.912170:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393726.912178:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393726.912189:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785393726.912222:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393726.912248:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace0186240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393726.912416:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316352 00000100:00100000:0.0:1785393726.912420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316352 00000100:00100000:0.0:1785393726.912448:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1785393726.912455:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831316352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393726.912463:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393726.912482:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a59 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.912503:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.912514:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.912529:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044600, rc 0) 00000100:00100000:0.0:1785393726.912561:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831316352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393726.912597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1785393726.912626:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393726.912638:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393726.912646:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393726.912681:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.912704:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.912717:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393726.912728:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316480 00000100:00100000:0.0:1785393726.912731:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316480 00000100:00100000:0.0:1785393726.912751:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1785393726.912757:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831316480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.912943:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831316480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393726.912950:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1785393726.912979:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.913002:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.913036:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.913056:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393726.913067:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316608 00000100:00100000:0.0:1785393726.913070:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316608 00000100:00100000:0.0:1785393726.913089:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1785393726.913094:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831316608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.913195:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831316608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393726.913201:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1785393726.913235:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831316608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393726.918580:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8439:1872120831316736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.918655:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.918693:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316736 00000100:00100000:0.0:1785393726.918699:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316736 00000100:00100000:0.0:1785393726.918734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1785393726.918743:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:8439:x1872120831316736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.918922:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:8439:x1872120831316736:12345-0@lo:502:llog_process_th.0 Request processed in 178us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393726.918930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1785393726.918977:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393726.918997:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8439:1872120831316736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.919020:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393726.919028:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.919031:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785393726.919038:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ace0136800 00000020:00000080:0.0:1785393726.919040:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785393726.919090:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8439:1872120831316864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393726.919123:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393726.919143:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6905240 going to sleep for 11 seconds 00000100:00100000:2.0:1785393726.922466:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316864 00000100:00100000:2.0:1785393726.922485:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316864 00000100:00100000:2.0:1785393726.922525:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1785393726.922532:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:8439:x1872120831316864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785393726.922754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:8439:x1872120831316864:12345-0@lo:502:llog_process_th.0 Request processed in 221us (3629us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393726.922761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1785393726.924639:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:8439:1872120831316864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393726.924676:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393726.924685:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393726.924687:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1785393726.924693:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1785393726.934501:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1785393726.934534:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785393726.934545:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393726.934558:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393727.013848:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831316992:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.013911:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.013949:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831317504:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.013972:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.013997:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785393727.014002:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831317120:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014020:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.014033:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831317632:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014050:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.014071:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831317376:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014088:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.014112:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393727.014116:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831317248:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014133:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393727.014153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831316992 00000100:00100000:1.0:1785393727.014159:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831316992 00000100:00100000:1.0:1785393727.014192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1785393727.014200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014237:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831316992:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014244:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1785393727.014269:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317504 00000100:00100000:1.0:1785393727.014272:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317504 00000100:00100000:1.0:1785393727.014296:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317120 00000100:00100000:1.0:1785393727.014299:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317120 00000100:00100000:1.0:1785393727.014310:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317248 00000100:00100000:1.0:1785393727.014312:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317248 00000100:00100000:1.0:1785393727.014324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785393727.014329:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831317504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831317504:12345-0@lo:400:kworker.0 Request processed in 121us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785393727.014470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785393727.014485:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014508:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831317120:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785393727.014523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785393727.014527:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014565:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831317248:12345-0@lo:400:kworker.0 Request processed in 37us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014587:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785393727.014605:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317632 00000100:00100000:1.0:1785393727.014608:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317632 00000100:00100000:1.0:1785393727.014629:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317376 00000100:00100000:1.0:1785393727.014631:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317376 00000100:00100000:1.0:1785393727.014644:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785393727.014649:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831317632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014675:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831317632:12345-0@lo:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014680:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785393727.014690:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785393727.014695:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014720:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831317376:12345-0@lo:400:kworker.0 Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.014725:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1785393727.014743:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393727.014746:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393727.014748:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393727.014773:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831317120:0@lo:400:kworker.0 00010000:00080000:1.0:1785393727.014784:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988e00 x1872120831317632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393727.014793:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831317632:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014800:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831316992:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.014816:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831317504:0@lo:400:kworker.0 00000100:00100000:2.0:1785393727.015486:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831317248:0@lo:400:kworker.0 00010000:00080000:2.0:1785393727.015498:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98b800 x1872120831317376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393727.015506:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831317376:0@lo:400:kworker.0 00000100:00100000:1.0:1785393727.178117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393727.178380:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393727.178448:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167744 00000100:00100000:2.0:1785393727.178457:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167744 00000100:00100000:2.0:1785393727.178515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1785393727.178523:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:2358:x1872120807167744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393727.178602:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:2358:x1872120807167744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393727.178609:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:3.0:1785393727.178947:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168000 00000100:00100000:3.0:1785393727.178952:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168000 00000100:00100000:3.0:1785393727.178996:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785393727.179004:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807168000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393727.179037:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807168000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393727.179056:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:1.0:1785393727.179245:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393727.182818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393727.182851:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393727.184181:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168128 00000100:00100000:2.0:1785393727.184190:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168128 00000100:00100000:2.0:1785393727.184246:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1785393727.184254:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807168128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393727.184311:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807168128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393727.184325:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00080000:1.0:1785393727.184480:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393727.184691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807167872 00000100:00100000:3.0:1785393727.184696:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807167872 00000100:00100000:3.0:1785393727.184740:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1785393727.184748:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807167872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393727.184792:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807167872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 45us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393727.184803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00080000:1.0:1785393727.185013:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393727.242695:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393727.242761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168256 00000100:00100000:2.0:1785393727.242775:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168256 00000100:00100000:2.0:1785393727.242889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:2.0:1785393727.242902:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:5582:x1872120807168256:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393727.242919:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393727.242935:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd52e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393727.242962:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393727.242975:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393727.242985:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1a00, rc 0) 00000100:00100000:2.0:1785393727.243043:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807168256:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393727.243050:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:3.0:1785393727.249691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393727.249962:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168384 00000100:00100000:0.0:1785393727.249971:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168384 00000100:00100000:0.0:1785393727.250011:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:0.0:1785393727.250020:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807168384:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393727.250247:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807168384:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 227us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393727.250257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1785393727.263611:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393727.263724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168512 00000100:00100000:1.0:1785393727.263736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168512 00000100:00100000:1.0:1785393727.263792:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1785393727.263807:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807168512:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393727.264093:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:5582:x1872120807168512:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 288us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393727.264104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1785393727.271655:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393727.273463:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168640 00000100:00100000:3.0:1785393727.273483:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168640 00000100:00100000:3.0:1785393727.273547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:3.0:1785393727.273591:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:6111:x1872120807168640:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785393727.273827:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:6111:x1872120807168640:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 270us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393727.273835:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:2.0:1785393727.292134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393727.292359:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168768 00000100:00100000:3.0:1785393727.292369:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168768 00000100:00100000:3.0:1785393727.292422:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:3.0:1785393727.292432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:6111:x1872120807168768:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785393727.292682:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:6111:x1872120807168768:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 250us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393727.292690:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:3.0:1785393727.520025:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831317760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393727.520107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393727.520361:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317760 00000100:00100000:3.0:1785393727.520369:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317760 00000100:00100000:3.0:1785393727.520413:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785393727.520422:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831317760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393727.520453:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393727.520959:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831317760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 536us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393727.520967:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1785393727.521011:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7acbb80 x1872120831317760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393727.521029:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831317760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393727.584668:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393728.031739:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393728.031760:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831317888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393728.031818:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393728.031902:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831317888 00000100:00100000:2.0:1785393728.031909:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831317888 00000100:00100000:2.0:1785393728.031955:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785393728.031963:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831317888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785393728.031996:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393728.032041:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831317888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393728.032048:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1785393728.032113:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98d880 x1872120831317888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393728.032131:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831317888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393728.608476:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393729.631883:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393730.658069:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393731.683654:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393732.138464:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831318016:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138565:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831318528:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138609:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138633:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785393732.138638:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831318144:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138655:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138684:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831318656:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138702:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138736:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831318272:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138755:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138770:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393732.138774:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831318400:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138790:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393732.138815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318528 00000100:00100000:0.0:1785393732.138820:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318528 00000100:00100000:0.0:1785393732.138857:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318144 00000100:00100000:0.0:1785393732.138859:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318144 00000100:00100000:0.0:1785393732.138867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318272 00000100:00100000:0.0:1785393732.138869:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318272 00000100:00100000:0.0:1785393732.138881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785393732.138887:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831318528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138929:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831318528:12345-0@lo:400:kworker.0 Request processed in 42us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393732.138934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785393732.138960:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785393732.138966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831318144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.138988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831318144:12345-0@lo:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393732.138993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785393732.139002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785393732.139006:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831318272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.139028:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831318272:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393732.139033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785393732.139049:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318656 00000100:00100000:0.0:1785393732.139058:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318656 00000100:00100000:0.0:1785393732.139082:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318400 00000100:00100000:0.0:1785393732.139084:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318400 00000100:00100000:0.0:1785393732.139098:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785393732.139103:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831318656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.139129:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831318656:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393732.139134:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393732.139505:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318016 00000100:00100000:2.0:1785393732.139511:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318016 00000100:00100000:2.0:1785393732.139540:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1785393732.139547:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831318016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393732.139606:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831318016:12345-0@lo:400:kworker.0 Request processed in 60us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393732.139612:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1785393732.140390:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785393732.140399:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831318400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.140433:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831318400:12345-0@lo:400:kworker.0 Request processed in 37us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393732.140455:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1785393732.140479:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393732.140483:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393732.140486:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785393732.140519:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a7b80 x1872120831318400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393732.140533:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831318400:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.140546:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831318272:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.140594:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831318144:0@lo:400:kworker.0 00010000:00080000:0.0:1785393732.140604:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9500 x1872120831318656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393732.140612:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831318656:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.140620:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831318016:0@lo:400:kworker.0 00000100:00100000:0.0:1785393732.140640:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831318528:0@lo:400:kworker.0 00000100:00100000:2.0:1785393732.298447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393732.298488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393732.298513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393732.298533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393732.298560:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169280 00000100:00100000:2.0:1785393732.298585:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169280 00000100:00100000:2.0:1785393732.298631:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169152 00000100:00100000:2.0:1785393732.298635:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169152 00000100:00100000:2.0:1785393732.298654:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785393732.298663:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807169280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393732.298725:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807169280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393732.298732:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785393732.298747:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1785393732.298753:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807169152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393732.298773:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807169152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393732.298785:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1785393732.298803:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807168896 00000100:00100000:2.0:1785393732.298807:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807168896 00000100:00100000:2.0:1785393732.298827:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1785393732.298832:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807168896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393732.298867:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807168896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393732.298874:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00080000:2.0:1785393732.298898:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393732.298901:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393732.300233:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169024 00000100:00100000:3.0:1785393732.300239:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169024 00000100:00100000:3.0:1785393732.300289:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1785393732.300297:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807169024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393732.300334:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807169024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393732.300340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00080000:2.0:1785393732.300485:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393732.644204:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393732.644226:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831318784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393732.644302:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393732.644474:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318784 00000100:00100000:1.0:1785393732.644482:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318784 00000100:00100000:1.0:1785393732.644532:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785393732.644541:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831318784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393732.644606:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393732.644652:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831318784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393732.644658:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1785393732.644709:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988e00 x1872120831318784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393732.644736:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831318784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393732.705411:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393733.156418:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393733.156448:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831318912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393733.156512:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393733.156605:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831318912 00000100:00100000:0.0:1785393733.156613:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831318912 00000100:00100000:0.0:1785393733.156655:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785393733.156663:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831318912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393733.156710:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393733.156754:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831318912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393733.156761:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1785393733.156801:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9500 x1872120831318912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393733.156817:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831318912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393733.737371:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393734.753083:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785393735.254384:0:8695:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1785393735.777708:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393736.808856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393737.249885:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831319040:0@lo:400:kworker.0 00000100:00100000:1.0:1785393737.249971:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393737.250231:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319040 00000100:00100000:2.0:1785393737.250245:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319040 00000100:00100000:2.0:1785393737.250304:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1785393737.250313:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831319040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.250480:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831319168:0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.250512:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393737.250567:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319168 00000100:00100000:0.0:1785393737.250587:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319168 00000100:00100000:0.0:1785393737.250617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1785393737.250624:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.250663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831319168:12345-0@lo:400:kworker.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.250670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1785393737.250736:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831319168:0@lo:400:kworker.0 00000100:00100000:2.0:1785393737.258705:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831319040:12345-0@lo:400:kworker.0 Request processed in 8385us (8725us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393737.258728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1785393737.260886:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831319040:0@lo:400:kworker.0 00000100:00100000:3.0:1785393737.261589:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393737.261603:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831319552:0@lo:400:kworker.0 00000100:00100000:3.0:1785393737.261673:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393737.261794:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831319296:0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.261824:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393737.261848:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393737.261854:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319424:0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.261879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393737.261907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319552 00000100:00100000:0.0:1785393737.261924:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319552 00000100:00100000:0.0:1785393737.261967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319296 00000100:00100000:0.0:1785393737.261970:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319296 00000100:00100000:0.0:1785393737.261987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785393737.261994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831319552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.262040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831319552:12345-0@lo:400:kworker.0 Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.262047:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785393737.262062:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785393737.262067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393737.262099:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831319296:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.262104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785393737.262138:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831319296:0@lo:400:kworker.0 00000100:00100000:3.0:1785393737.262378:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831319552:0@lo:400:kworker.0 00000100:00100000:1.0:1785393737.262991:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393737.263001:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831319680:0@lo:400:kworker.0 00000100:00100000:1.0:1785393737.263034:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393737.263362:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319424 00000100:00100000:2.0:1785393737.263368:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319424 00000100:00100000:2.0:1785393737.263403:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319680 00000100:00100000:2.0:1785393737.263538:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319680 00000100:00100000:2.0:1785393737.263589:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393737.263597:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393737.263636:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319424:12345-0@lo:400:kworker.0 Request processed in 41us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393737.263654:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393737.263666:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785393737.263672:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831319680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393737.263703:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831319680:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393737.263709:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1785393737.264080:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7acaa00 x1872120831319680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393737.264093:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831319680:0@lo:400:kworker.0 00000100:00080000:3.0:1785393737.264273:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393737.264278:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393737.264331:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785393737.264361:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7aca300 x1872120831319424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393737.264372:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319424:0@lo:400:kworker.0 00000100:00100000:2.0:1785393737.423551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393737.423642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393737.423677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393737.423698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393737.423705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169536 00000100:00100000:3.0:1785393737.423713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169536 00000100:00100000:2.0:1785393737.423719:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169664 00000100:00100000:2.0:1785393737.423722:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169664 00000100:00100000:1.0:1785393737.423766:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169792 00000100:00100000:3.0:1785393737.423770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1785393737.423770:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169792 00000100:00100000:3.0:1785393737.423779:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807169536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393737.423824:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169408 00000100:00100000:0.0:1785393737.423827:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169408 00000100:00100000:3.0:1785393737.423853:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807169536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.423853:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1785393737.423860:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1785393737.423860:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807169408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393737.423891:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807169408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.423910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1785393737.426542:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1785393737.426554:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2357:x1872120807169664:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1785393737.426899:0:6630:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36299a3 00000100:00080000:2.0:1785393737.426910:0:6630:0:(import.c:65:import_set_state_nolock()) ffff93abc125f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785393737.427041:0:6630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1785393737.427440:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807169664:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 888us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393737.427449:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:3.0:1785393737.432653:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393737.432664:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393737.432667:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785393737.434616:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393737.441695:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1785393737.441718:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2357:x1872120807169792:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1785393737.441757:0:6631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36299aa 00000100:00080000:0.0:1785393737.441766:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93abc1259800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785393737.441800:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785393737.442122:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807169792:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 413us (18420us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393737.442130:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:1.0:1785393737.442278:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393737.770072:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393737.770133:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393737.770375:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319808 00000100:00100000:1.0:1785393737.770382:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319808 00000100:00100000:1.0:1785393737.770459:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785393737.770467:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393737.770498:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393737.770535:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393737.770541:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1785393737.770685:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7aca300 x1872120831319808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393737.770701:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393737.823740:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785393737.833421:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:1.0:1785393737.833431:0:6656:0:(genops.c:906:class_export_put()) final put ffff93abc125c000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:2.0:1785393737.833642:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc125c000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0000 00000020:00000080:2.0:1785393737.833762:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc125f000 for lustre-OST0000 00000100:00100000:3.0:1785393738.272709:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393738.272732:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393738.272794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393738.272893:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831319936 00000100:00100000:0.0:1785393738.272900:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831319936 00000100:00100000:0.0:1785393738.272948:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785393738.272957:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393738.272989:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393738.273033:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831319936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393738.273040:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1785393738.273106:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9880 x1872120831319936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393738.273122:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831319936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393738.854075:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393739.874726:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393740.897875:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785393741.395548:0:8941:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00010000:00010000:2.0:1785393741.922661:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393742.371621:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831320192:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371688:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371750:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831320704:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371776:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371809:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785393742.371815:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831320064:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371842:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371866:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831320576:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371884:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371911:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831320320:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371932:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371951:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393742.371956:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831320448:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.371974:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.371999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320192 00000100:00100000:3.0:1785393742.372005:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320192 00000100:00100000:3.0:1785393742.372037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320576 00000100:00100000:3.0:1785393742.372039:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320576 00000100:00100000:3.0:1785393742.372055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320320 00000100:00100000:3.0:1785393742.372056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320320 00000100:00100000:3.0:1785393742.372068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785393742.372075:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831320192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372118:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831320192:12345-0@lo:400:kworker.0 Request processed in 42us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.372124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785393742.372137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785393742.372141:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831320576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372176:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831320576:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.372181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785393742.372190:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785393742.372195:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831320320:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.372224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785393742.372240:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320704 00000100:00100000:3.0:1785393742.372243:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320704 00000100:00100000:3.0:1785393742.372265:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320448 00000100:00100000:3.0:1785393742.372268:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320448 00000100:00100000:3.0:1785393742.372286:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785393742.372292:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831320704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372323:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831320704:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.372328:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785393742.372340:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785393742.372346:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372390:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831320448:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.372396:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1785393742.372419:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393742.372423:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393742.372425:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785393742.372457:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab1880 x1872120831320448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393742.372484:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831320448:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372500:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831320320:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372530:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831320576:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.372539:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831320192:0@lo:400:kworker.0 00010000:00080000:3.0:1785393742.372549:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab0000 x1872120831320704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393742.372558:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831320704:0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.374914:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320064 00000100:00100000:3.0:1785393742.374924:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320064 00000100:00100000:3.0:1785393742.400294:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785393742.400312:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831320064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393742.400421:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831320064:12345-0@lo:400:kworker.0 Request processed in 116us (28577us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.400429:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785393742.400491:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831320064:0@lo:400:kworker.0 00000001:00100000:0.0:1785393742.508318:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:0.0:1785393742.508327:0:7533:0:(genops.c:906:class_export_put()) final put ffff93abc125a800/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:0.0:1785393742.508353:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc125a800/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0001 00000020:00000080:0.0:1785393742.508405:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc1259800 for lustre-OST0001 00000100:00100000:2.0:1785393742.543013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393742.543043:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807169920 00000100:00100000:2.0:1785393742.543051:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807169920 00000100:00100000:2.0:1785393742.543104:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1785393742.543114:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807169920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393742.543181:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807169920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393742.543188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1785393742.555758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393742.558004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170048 00000100:00100000:3.0:1785393742.558015:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170048 00000100:00100000:3.0:1785393742.558099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1785393742.558109:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807170048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393742.558179:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807170048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.558186:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00080000:2.0:1785393742.558313:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393742.885341:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393742.885360:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831320832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393742.885429:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393742.885489:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320832 00000100:00100000:3.0:1785393742.885495:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320832 00000100:00100000:3.0:1785393742.885532:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785393742.885539:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831320832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393742.885593:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393742.885635:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831320832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393742.885642:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1785393742.885689:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab0000 x1872120831320832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393742.885707:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831320832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393742.950087:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393743.391943:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831320960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393743.392034:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393743.392429:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831320960 00000100:00100000:0.0:1785393743.392439:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831320960 00000100:00100000:0.0:1785393743.392518:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785393743.392531:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831320960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393743.392615:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393743.392687:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831320960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393743.392695:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1785393743.393054:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9c00 x1872120831320960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393743.393076:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831320960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393743.967787:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393744.993076:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393746.015825:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393747.040754:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393747.487854:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831321088:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.487948:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393747.488003:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831321600:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488055:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393747.488086:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785393747.488091:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831321216:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393747.488128:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831321728:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488288:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393747.488323:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321600 00000100:00100000:1.0:1785393747.488331:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321600 00000100:00100000:1.0:1785393747.488411:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321216 00000100:00100000:1.0:1785393747.488415:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321216 00000100:00100000:1.0:1785393747.488435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1785393747.488443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831321600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831321600:12345-0@lo:400:kworker.0 Request processed in 55us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393747.488505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1785393747.488524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1785393747.488530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831321216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488559:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831321216:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393747.488565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1785393747.488618:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321728 00000100:00100000:1.0:1785393747.488622:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321728 00000100:00100000:1.0:1785393747.488651:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785393747.488657:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831321728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488688:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831321728:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393747.488694:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785393747.488739:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831321216:0@lo:400:kworker.0 00010000:00080000:1.0:1785393747.488753:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab3480 x1872120831321728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393747.488763:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831321728:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.488781:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831321600:0@lo:400:kworker.0 00000100:00100000:2.0:1785393747.488869:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831321344:0@lo:400:kworker.0 00000100:00100000:2.0:1785393747.488900:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393747.488926:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393747.488932:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831321472:0@lo:400:kworker.0 00000100:00100000:2.0:1785393747.488953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785393747.488980:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393747.488985:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393747.488995:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321472 00000100:00100000:2.0:1785393747.488999:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321472 00000100:00100000:2.0:1785393747.489041:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785393747.489048:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831321472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393747.489083:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831321472:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393747.489089:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1785393747.489108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785393747.489134:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab2680 x1872120831321472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393747.489298:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831321472:0@lo:400:kworker.0 00000100:00100000:3.0:1785393747.489559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321088 00000100:00100000:3.0:1785393747.489565:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321088 00000100:00100000:3.0:1785393747.489628:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1785393747.489636:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831321088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393747.489698:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831321088:12345-0@lo:400:kworker.0 Request processed in 63us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393747.489771:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1785393747.490283:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321344 00000100:00100000:1.0:1785393747.490289:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321344 00000100:00100000:1.0:1785393747.492469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785393747.492483:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831321344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.492591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831321344:12345-0@lo:400:kworker.0 Request processed in 112us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393747.492599:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785393747.492653:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831321344:0@lo:400:kworker.0 00000100:00100000:1.0:1785393747.492699:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831321088:0@lo:400:kworker.0 00000100:00080000:2.0:1785393747.499458:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393747.654926:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393747.655033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393747.655604:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170176 00000100:00100000:0.0:1785393747.655615:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170176 00000100:00100000:0.0:1785393747.655678:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1785393747.655689:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2360:x1872120807170176:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393747.655797:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2360:x1872120807170176:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 109us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393747.655805:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1785393747.664614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170304 00000100:00100000:1.0:1785393747.664635:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170304 00000100:00100000:1.0:1785393747.665258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1785393747.665269:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807170304:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1785393747.665528:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393747.665904:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807170304:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 635us (10991us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393747.665913:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1785393748.001220:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393748.001260:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831321856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393748.001496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393748.001611:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321856 00000100:00100000:2.0:1785393748.001620:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321856 00000100:00100000:2.0:1785393748.001685:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393748.001697:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831321856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393748.001739:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393748.001795:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831321856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393748.001802:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1785393748.002072:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc848b100 x1872120831321856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393748.002091:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831321856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393748.064637:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785393748.485941:0:9136:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.2 00000100:00100000:2.0:1785393748.518124:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831321984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393748.518228:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393748.518308:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831321984 00000100:00100000:0.0:1785393748.518319:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831321984 00000100:00100000:0.0:1785393748.518387:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785393748.518397:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831321984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393748.518434:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393748.518518:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831321984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393748.518526:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1785393748.518566:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8000 x1872120831321984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393748.518615:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831321984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393749.087906:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393750.114588:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393751.135700:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785393751.966557:0:9233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.2 00010000:00010000:1.0:1785393752.159699:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393752.608751:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831322368:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.608813:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393752.608876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322368 00000100:00100000:1.0:1785393752.608883:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322368 00000100:00100000:3.0:1785393752.608984:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831322112:0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.609013:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393752.609043:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393752.609047:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831322240:0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.609064:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393752.609085:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322112 00000100:00100000:3.0:1785393752.609089:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322112 00000100:00100000:3.0:1785393752.609114:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1785393752.609120:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831322112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.609165:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831322112:12345-0@lo:400:kworker.0 Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393752.609171:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1785393752.609197:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322240 00000100:00100000:3.0:1785393752.609200:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322240 00000100:00100000:3.0:1785393752.609222:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785393752.609228:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831322240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.609259:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831322240:12345-0@lo:400:kworker.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393752.609266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785393752.609302:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831322240:0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.609323:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831322112:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.610109:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785393752.610117:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831322368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.610211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831322368:12345-0@lo:400:kworker.0 Request processed in 95us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393752.610217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1785393752.610235:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393752.610256:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831322368:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.610292:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831322496:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.610329:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393752.610356:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322496 00000100:00100000:1.0:1785393752.610359:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322496 00000100:00100000:1.0:1785393752.610386:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785393752.610392:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831322496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.610423:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831322496:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393752.610428:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1785393752.610443:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785393752.610458:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8489180 x1872120831322496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393752.610469:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831322496:0@lo:400:kworker.0 00000100:00100000:2.0:1785393752.610593:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831322752:0@lo:400:kworker.0 00000100:00100000:2.0:1785393752.610638:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393752.610656:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393752.610662:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831322624:0@lo:400:kworker.0 00000100:00100000:2.0:1785393752.610682:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393752.610823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322624 00000100:00100000:3.0:1785393752.610828:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322624 00000100:00100000:3.0:1785393752.610853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785393752.610858:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831322624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393752.610898:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831322624:12345-0@lo:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393752.610904:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1785393752.610926:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393752.610943:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831322624:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.611793:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322752 00000100:00100000:1.0:1785393752.611797:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322752 00000100:00100000:1.0:1785393752.611842:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785393752.611847:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.611884:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831322752:12345-0@lo:400:kworker.0 Request processed in 37us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393752.611889:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1785393752.614237:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785393752.614271:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc848aa00 x1872120831322752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393752.614283:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831322752:0@lo:400:kworker.0 00000100:00100000:1.0:1785393752.775587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393752.775624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393752.775658:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170560 00000100:00100000:1.0:1785393752.775667:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170560 00000100:00100000:1.0:1785393752.775721:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1785393752.775731:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807170560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393752.775798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807170560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393752.775806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1785393752.783345:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170432 00000100:00100000:3.0:1785393752.783358:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170432 00000100:00100000:3.0:1785393752.783411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1785393752.783421:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807170432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393752.783492:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807170432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (7866us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393752.783499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00080000:3.0:1785393752.783529:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393753.123457:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393753.123477:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831322880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393753.123535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393753.123606:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831322880 00000100:00100000:2.0:1785393753.123613:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831322880 00000100:00100000:2.0:1785393753.123650:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785393753.123657:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831322880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393753.123689:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393753.123724:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831322880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393753.123742:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1785393753.123791:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a1c00 x1872120831322880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393753.123806:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831322880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393753.187369:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393753.631815:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393753.631834:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831323008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393753.631891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393753.631995:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323008 00000100:00100000:0.0:1785393753.632002:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323008 00000100:00100000:0.0:1785393753.632041:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785393753.632049:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831323008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393753.632090:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393753.632140:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831323008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393753.632147:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1785393753.632395:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8e00 x1872120831323008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393753.632412:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831323008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393754.211507:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785393754.861075:0:9331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.2 00010000:00010000:1.0:1785393755.231916:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393756.257877:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785393757.146863:0:9379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Jul 30 02:42:34 EDT 2026 00010000:00010000:2.0:1785393757.279665:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393757.728835:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831323392:0@lo:400:kworker.0 00000100:00100000:1.0:1785393757.728898:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393757.728951:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393757.728957:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831323520:0@lo:400:kworker.0 00000100:00100000:1.0:1785393757.728980:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393757.729029:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323520 00000100:00100000:1.0:1785393757.729035:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323520 00000100:00100000:1.0:1785393757.729081:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785393757.729089:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831323520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393757.729139:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831323520:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393757.729145:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785393757.729457:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831323136:0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393757.729520:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831323648:0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729538:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393757.729555:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785393757.729560:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831323264:0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729610:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393757.729629:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831323776:0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393757.729674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323392 00000100:00100000:3.0:1785393757.729678:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323392 00000100:00100000:3.0:1785393757.729697:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323648 00000100:00100000:3.0:1785393757.729699:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323648 00000100:00100000:3.0:1785393757.729710:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323264 00000100:00100000:3.0:1785393757.729712:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323264 00000100:00100000:3.0:1785393757.729723:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785393757.729728:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831323392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729772:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831323392:12345-0@lo:400:kworker.0 Request processed in 43us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.729778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785393757.729791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1785393757.729797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831323648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729825:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831323648:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.729830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1785393757.729839:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785393757.729844:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831323264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729866:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831323264:12345-0@lo:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.729871:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785393757.729885:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323136 00000100:00100000:3.0:1785393757.729888:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323136 00000100:00100000:3.0:1785393757.729907:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1785393757.729918:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831323136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.729946:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831323136:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.729952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1785393757.729989:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323776 00000100:00100000:3.0:1785393757.729993:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323776 00010000:00080000:0.0:1785393757.730082:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8488a80 x1872120831323520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393757.730094:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831323520:0@lo:400:kworker.0 00000100:00100000:0.0:1785393757.730113:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831323392:0@lo:400:kworker.0 00000100:00080000:0.0:1785393757.730139:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393757.730143:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393757.730145:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393757.730833:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831323264:0@lo:400:kworker.0 00000100:00100000:0.0:1785393757.730843:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831323136:0@lo:400:kworker.0 00000100:00100000:0.0:1785393757.730851:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831323648:0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.740395:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785393757.740413:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831323776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393757.740593:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831323776:12345-0@lo:400:kworker.0 Request processed in 187us (10942us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.740600:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1785393757.740707:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc848b800 x1872120831323776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393757.740723:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831323776:0@lo:400:kworker.0 00000100:00100000:2.0:1785393757.891349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393757.891402:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393757.891543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170688 00000100:00100000:0.0:1785393757.891553:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170688 00000100:00100000:0.0:1785393757.891632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1785393757.891642:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807170688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393757.891710:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2358:x1872120807170688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393757.891732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:3.0:1785393757.893410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170816 00000100:00100000:3.0:1785393757.893418:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170816 00000100:00100000:3.0:1785393757.893489:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1785393757.893497:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807170816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393757.893544:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807170816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393757.893550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00080000:1.0:1785393757.893792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393758.242624:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393758.242646:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831323904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393758.242710:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393758.242789:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831323904 00000100:00100000:3.0:1785393758.242796:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831323904 00000100:00100000:3.0:1785393758.242835:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785393758.242843:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831323904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393758.242874:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393758.242923:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831323904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393758.242929:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1785393758.242967:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab3480 x1872120831323904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393758.242983:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831323904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393758.304740:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393758.751695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393758.751722:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831324032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393758.751808:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393758.751882:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324032 00000100:00100000:1.0:1785393758.751891:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324032 00000100:00100000:1.0:1785393758.751946:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785393758.751957:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831324032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393758.752002:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393758.752050:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831324032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393758.752059:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1785393758.752106:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc848b100 x1872120831324032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393758.752128:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831324032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393759.329670:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393760.363693:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393761.375713:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393762.408601:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393762.850128:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831324544:0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.850222:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393762.850310:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393762.850316:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831324416:0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.850372:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393762.850414:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324416 00000100:00100000:1.0:1785393762.850422:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324416 00000100:00100000:1.0:1785393762.850483:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785393762.850494:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.850545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831324416:12345-0@lo:400:kworker.0 Request processed in 54us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393762.850552:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1785393762.850589:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393762.850622:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831324416:0@lo:400:kworker.0 00000100:00100000:3.0:1785393762.850807:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831324288:0@lo:400:kworker.0 00000100:00100000:3.0:1785393762.850836:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393762.850881:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831324800:0@lo:400:kworker.0 00000100:00100000:3.0:1785393762.850901:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393762.850922:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785393762.850927:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831324160:0@lo:400:kworker.0 00000100:00100000:3.0:1785393762.850951:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393762.850966:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831324672:0@lo:400:kworker.0 00000100:00100000:3.0:1785393762.850982:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393762.851396:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324544 00000100:00100000:0.0:1785393762.851401:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324544 00000100:00100000:0.0:1785393762.851439:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324800 00000100:00100000:0.0:1785393762.851442:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324800 00000100:00100000:0.0:1785393762.851460:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785393762.851466:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831324544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393762.851509:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831324544:12345-0@lo:400:kworker.0 Request processed in 44us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393762.851515:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785393762.851525:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785393762.851530:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831324800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393762.851556:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831324800:12345-0@lo:400:kworker.0 Request processed in 26us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393762.851560:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1785393762.851609:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8488e00 x1872120831324800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393762.851620:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831324800:0@lo:400:kworker.0 00010000:00080000:0.0:1785393762.851643:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8489c00 x1872120831324544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393762.851650:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831324544:0@lo:400:kworker.0 00000100:00080000:3.0:1785393762.851709:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393762.851713:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393762.853044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324288 00000100:00100000:1.0:1785393762.853052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324288 00000100:00100000:1.0:1785393762.853092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324672 00000100:00100000:1.0:1785393762.853095:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324672 00000100:00100000:1.0:1785393762.853121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785393762.853129:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831324288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.853186:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831324288:12345-0@lo:400:kworker.0 Request processed in 57us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393762.853193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785393762.853207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785393762.853213:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.853251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831324672:12345-0@lo:400:kworker.0 Request processed in 38us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393762.853273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1785393762.853406:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393762.853498:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324160 00000100:00100000:1.0:1785393762.853503:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324160 00000100:00100000:1.0:1785393762.853539:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1785393762.853547:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831324160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393762.853600:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831324160:12345-0@lo:400:kworker.0 Request processed in 54us (2648us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393762.853606:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1785393762.854189:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831324160:0@lo:400:kworker.0 00000100:00100000:0.0:1785393762.854207:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831324672:0@lo:400:kworker.0 00000100:00100000:0.0:1785393762.854235:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831324288:0@lo:400:kworker.0 00000100:00100000:3.0:1785393763.015687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393763.015743:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807170944 00000100:00100000:3.0:1785393763.015748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393763.015756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807170944 00000100:00100000:1.0:1785393763.015821:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:1.0:1785393763.015833:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807170944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393763.015938:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2361:x1872120807170944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393763.015947:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1785393763.016125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171072 00000100:00100000:2.0:1785393763.016132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171072 00000100:00100000:2.0:1785393763.016190:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1785393763.016199:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807171072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393763.016255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807171072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393763.016282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00080000:3.0:1785393763.016404:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393763.367637:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831324928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393763.367719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393763.367813:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831324928 00000100:00100000:3.0:1785393763.367822:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831324928 00000100:00100000:3.0:1785393763.367874:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785393763.367883:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831324928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393763.367933:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393763.367980:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831324928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393763.367987:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1785393763.368033:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889ca80 x1872120831324928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393763.368052:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831324928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393763.427383:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393763.874198:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393763.874243:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831325056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393763.874343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393763.874616:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325056 00000100:00100000:1.0:1785393763.874627:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325056 00000100:00100000:1.0:1785393763.874735:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785393763.874745:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831325056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393763.874803:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393763.874855:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831325056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393763.874862:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1785393763.875505:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea4380 x1872120831325056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393763.875526:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831325056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393764.449815:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393765.481257:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393766.495853:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393767.524783:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393767.967946:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831325568:0@lo:400:kworker.0 00000100:00100000:0.0:1785393767.968028:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393767.968102:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393767.968109:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831325440:0@lo:400:kworker.0 00000100:00100000:0.0:1785393767.968136:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393767.968168:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325568 00000100:00100000:0.0:1785393767.968192:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325568 00000100:00100000:3.0:1785393767.968326:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831325184:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968366:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393767.968408:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831325696:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968432:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393767.968454:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785393767.968459:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831325312:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968483:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393767.968501:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831325824:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393767.968544:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325440 00000100:00100000:3.0:1785393767.968564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325440 00000100:00100000:3.0:1785393767.968614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325696 00000100:00100000:3.0:1785393767.968617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325696 00000100:00100000:3.0:1785393767.968628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325312 00000100:00100000:3.0:1785393767.968630:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325312 00000100:00100000:3.0:1785393767.968642:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785393767.968649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831325440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968703:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831325440:12345-0@lo:400:kworker.0 Request processed in 54us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.968709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785393767.968724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785393767.968729:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831325696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968753:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831325696:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.968758:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785393767.968766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785393767.968771:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831325312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968790:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831325312:12345-0@lo:400:kworker.0 Request processed in 19us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.968794:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1785393767.968807:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393767.968811:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393767.968820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325184 00000100:00100000:3.0:1785393767.968824:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325184 00000100:00100000:3.0:1785393767.968844:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1785393767.968849:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831325184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968873:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831325184:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.968884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1785393767.968917:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325824 00000100:00100000:3.0:1785393767.968920:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325824 00000100:00100000:3.0:1785393767.968942:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785393767.968947:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831325568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.968974:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831325568:12345-0@lo:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.968979:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785393767.968988:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785393767.968993:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831325824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.969013:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831325824:12345-0@lo:400:kworker.0 Request processed in 20us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393767.969018:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1785393767.969072:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393767.969686:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831325312:0@lo:400:kworker.0 00010000:00080000:3.0:1785393767.969700:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8e00 x1872120831325824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393767.969709:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831325824:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.969716:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831325184:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.969725:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831325696:0@lo:400:kworker.0 00000100:00100000:3.0:1785393767.969752:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831325440:0@lo:400:kworker.0 00010000:00080000:3.0:1785393767.969761:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007bbb80 x1872120831325568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393767.969779:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831325568:0@lo:400:kworker.0 00000100:00100000:1.0:1785393768.141654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393768.141696:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171328 00000100:00100000:1.0:1785393768.141707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171328 00000100:00100000:1.0:1785393768.141778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1785393768.141791:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393768.141875:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393768.141882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00080000:1.0:1785393768.141905:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393768.159528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393768.159590:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171200 00000100:00100000:1.0:1785393768.159601:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171200 00000100:00100000:1.0:1785393768.159660:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1785393768.159671:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393768.159750:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393768.159758:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:3.0:1785393768.480716:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831325952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393768.480802:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393768.480901:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831325952 00000100:00100000:3.0:1785393768.480910:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831325952 00000100:00100000:3.0:1785393768.480960:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785393768.480970:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831325952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393768.481025:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393768.481078:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831325952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393768.481086:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1785393768.481135:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a0e00 x1872120831325952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393768.481156:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831325952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393768.545692:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393768.994647:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393768.994685:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831326080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393768.994774:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393768.995100:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326080 00000100:00100000:1.0:1785393768.995110:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326080 00000100:00100000:1.0:1785393768.995167:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785393768.995177:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831326080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393768.995231:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393768.995293:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831326080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393768.995300:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1785393768.995449:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea7100 x1872120831326080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393768.995470:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831326080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393769.570389:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393770.594744:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393771.619396:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393772.648391:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393773.094920:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831326592:0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.095030:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393773.095104:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393773.095111:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831326464:0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.095138:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393773.095182:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326592 00000100:00100000:1.0:1785393773.095190:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326592 00000100:00100000:1.0:1785393773.095254:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785393773.095264:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.095318:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831326592:12345-0@lo:400:kworker.0 Request processed in 55us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393773.095325:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785393773.095349:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326464 00000100:00100000:1.0:1785393773.095351:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326464 00000100:00100000:1.0:1785393773.095375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785393773.095380:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.095405:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831326464:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393773.095411:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1785393773.095426:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393773.095431:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393773.095466:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831326464:0@lo:400:kworker.0 00010000:00080000:1.0:1785393773.095480:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea7480 x1872120831326592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393773.095490:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831326592:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.095559:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831326208:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.095618:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393773.095643:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831326720:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.095662:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393773.095677:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785393773.095682:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831326336:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.095702:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393773.095713:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831326848:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.095732:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393773.095803:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326208 00000100:00100000:1.0:1785393773.095806:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326208 00000100:00100000:0.0:1785393773.095926:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326848 00000100:00100000:0.0:1785393773.095931:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326848 00000100:00100000:0.0:1785393773.095963:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785393773.095970:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831326848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393773.096012:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831326848:12345-0@lo:400:kworker.0 Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393773.096019:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1785393773.096214:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1785393773.096245:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea6a00 x1872120831326848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393773.096262:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831326848:0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.096303:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1785393773.096310:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831326208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393773.096349:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831326208:12345-0@lo:400:kworker.0 Request processed in 40us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393773.096356:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1785393773.096407:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831326208:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.110303:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326720 00000100:00100000:2.0:1785393773.110323:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326720 00000100:00100000:2.0:1785393773.110410:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326336 00000100:00100000:2.0:1785393773.110414:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326336 00000100:00100000:2.0:1785393773.110435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785393773.110446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.110588:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831326720:12345-0@lo:400:kworker.0 Request processed in 143us (14923us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393773.110596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785393773.110613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785393773.110619:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831326336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.110649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831326336:12345-0@lo:400:kworker.0 Request processed in 30us (14946us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393773.110655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785393773.110712:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831326336:0@lo:400:kworker.0 00000100:00100000:2.0:1785393773.110744:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831326720:0@lo:400:kworker.0 00000100:00080000:0.0:1785393773.113026:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393773.251904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393773.251968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393773.252117:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171456 00000100:00100000:0.0:1785393773.252129:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171456 00000100:00100000:0.0:1785393773.252216:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1785393773.252228:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393773.252316:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393773.252324:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1785393773.252463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171584 00000100:00100000:2.0:1785393773.252468:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171584 00000100:00100000:2.0:1785393773.252524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:2.0:1785393773.252530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393773.252598:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393773.252605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00080000:0.0:1785393773.252667:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393773.603263:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831326976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393773.603354:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393773.604233:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831326976 00000100:00100000:2.0:1785393773.604244:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831326976 00000100:00100000:2.0:1785393773.604308:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785393773.604318:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831326976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393773.604362:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393773.604438:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831326976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393773.604446:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1785393773.604608:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a3b80 x1872120831326976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393773.604630:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831326976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393773.667151:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393774.115766:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831327104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393774.115854:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393774.115957:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327104 00000100:00100000:3.0:1785393774.115977:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327104 00000100:00100000:3.0:1785393774.116154:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785393774.116184:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831327104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393774.116231:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393774.116284:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831327104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393774.116291:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1785393774.116332:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea5c00 x1872120831327104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393774.116351:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831327104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393774.690213:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393775.715301:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393776.738044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393777.759745:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393778.210739:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831327360:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.210824:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.210882:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831327872:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.210907:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.210940:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785393778.210946:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831327232:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.210978:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.210996:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831327744:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211018:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.211044:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831327616:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211069:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.211087:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393778.211093:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831327488:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211113:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393778.211151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327360 00000100:00100000:1.0:1785393778.211175:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327360 00000100:00100000:1.0:1785393778.211217:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327744 00000100:00100000:1.0:1785393778.211219:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327744 00000100:00100000:1.0:1785393778.211254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327488 00000100:00100000:1.0:1785393778.211257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327488 00000100:00100000:1.0:1785393778.211275:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785393778.211285:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831327360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211336:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831327360:12345-0@lo:400:kworker.0 Request processed in 53us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785393778.211361:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785393778.211366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831327744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211388:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831327744:12345-0@lo:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211394:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785393778.211403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785393778.211408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831327488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211431:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831327488:12345-0@lo:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211436:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785393778.211454:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327872 00000100:00100000:1.0:1785393778.211457:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327872 00000100:00100000:1.0:1785393778.211478:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327616 00000100:00100000:1.0:1785393778.211480:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327616 00000100:00100000:1.0:1785393778.211494:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785393778.211500:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831327872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211526:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831327872:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211541:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785393778.211552:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785393778.211557:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831327616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211604:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831327616:12345-0@lo:400:kworker.0 Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211610:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785393778.211626:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831327232 00000100:00100000:1.0:1785393778.211629:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831327232 00000100:00100000:1.0:1785393778.211651:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1785393778.211657:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831327232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211683:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831327232:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.211689:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:1.0:1785393778.211718:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393778.211722:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393778.211725:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393778.211753:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831327488:0@lo:400:kworker.0 00010000:00080000:1.0:1785393778.211767:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea6680 x1872120831327616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393778.211777:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831327616:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211804:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831327232:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211812:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831327744:0@lo:400:kworker.0 00000100:00100000:1.0:1785393778.211821:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831327360:0@lo:400:kworker.0 00010000:00080000:1.0:1785393778.211840:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea5c00 x1872120831327872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393778.211849:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831327872:0@lo:400:kworker.0 00000100:00100000:0.0:1785393778.371392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393778.371448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393778.371480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171712 00000100:00100000:0.0:1785393778.371491:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171712 00000100:00100000:0.0:1785393778.371549:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:0.0:1785393778.371561:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393778.371664:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807171712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393778.371672:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1785393778.371890:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171840 00000100:00100000:1.0:1785393778.371895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171840 00000100:00100000:1.0:1785393778.371957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1785393778.371965:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393778.372008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807171840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393778.372015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00080000:0.0:1785393778.372171:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393778.727432:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393778.727470:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393778.727609:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393778.730938:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328000 00000100:00100000:2.0:1785393778.730953:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328000 00000100:00100000:2.0:1785393778.731025:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785393778.731037:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831328000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393778.731179:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393778.731310:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831328000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393778.731318:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1785393778.732223:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a0380 x1872120831328000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393778.732266:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831328000:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1785393778.791793:0:10009:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:42:55 (1785393775) === 00010000:00010000:0.0:1785393778.797543:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393779.236308:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393779.236336:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831328128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393779.236422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393779.236496:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328128 00000100:00100000:1.0:1785393779.236504:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328128 00000100:00100000:1.0:1785393779.236556:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785393779.236566:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831328128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393779.236627:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393779.236674:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831328128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393779.236681:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1785393779.236737:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea4e00 x1872120831328128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393779.236758:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831328128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393779.580724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.580849:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807171968 00000100:00100000:2.0:1785393779.580861:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807171968 00000100:00100000:2.0:1785393779.580937:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1785393779.580949:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:8107:x1872120807171968:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785393779.580979:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393779.581003:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0800/0xcc9b96d8b3629a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd535 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.581039:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0800/0xcc9b96d8b3629a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd535 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.581053:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0800/0xcc9b96d8b3629a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd535 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.581064:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0800, rc 0) 00000100:00100000:2.0:1785393779.581151:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807171968:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 204us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.581390:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1785393779.593526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.600269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172096 00000100:00100000:0.0:1785393779.600287:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172096 00000100:00100000:0.0:1785393779.600438:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1785393779.600450:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807172096:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785393779.600835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807172096:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 387us (7323us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.600844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1785393779.609526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.609770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172224 00000100:00100000:2.0:1785393779.609783:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172224 00000100:00100000:2.0:1785393779.609858:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1785393779.609869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807172224:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785393779.610477:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807172224:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 607us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.610486:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1785393779.627506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.629355:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172352 00000100:00100000:2.0:1785393779.629373:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172352 00000100:00100000:2.0:1785393779.629453:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:2.0:1785393779.629465:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8111:x1872120807172352:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785393779.629853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8111:x1872120807172352:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 389us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.629861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:1.0:1785393779.671654:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.671761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172480 00000100:00100000:0.0:1785393779.671774:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172480 00000100:00100000:0.0:1785393779.671853:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:0.0:1785393779.671866:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8111:x1872120807172480:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785393779.673485:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8111:x1872120807172480:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 1617us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.673497:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1785393779.677978:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393779.678099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172608 00000100:00100000:3.0:1785393779.678110:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172608 00000100:00100000:3.0:1785393779.678185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1785393779.678196:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:8107:x1872120807172608:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785393779.678217:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393779.678238:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0e00/0xcc9b96d8b3629a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd55f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393779.678270:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0e00/0xcc9b96d8b3629a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd55f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393779.678282:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0e00/0xcc9b96d8b3629a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd55f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393779.678292:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0e00, rc 0) 00000100:00100000:3.0:1785393779.678375:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:8107:x1872120807172608:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 180us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393779.678383:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1785393779.688623:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.691950:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172736 00000100:00100000:0.0:1785393779.691975:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172736 00000100:00100000:0.0:1785393779.692059:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:0.0:1785393779.692071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:8107:x1872120807172736:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1785393779.692111:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1785393779.692146:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1785393779.692151:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1785393779.692161:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1785393779.692164:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1785393779.704411:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:8107:x1872120807172736:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 12327us (15842us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.704430:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1785393779.715528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.715669:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172864 00000100:00100000:2.0:1785393779.715680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172864 00000100:00100000:2.0:1785393779.715744:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1785393779.715755:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:8107:x1872120807172864:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785393779.715776:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393779.715806:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd566 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.715840:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.715854:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393779.715865:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0c00, rc 0) 00000100:00100000:2.0:1785393779.715933:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8107:x1872120807172864:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 179us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.715940:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1785393779.724381:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.724490:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807172992 00000100:00100000:0.0:1785393779.724502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807172992 00000100:00100000:0.0:1785393779.724566:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:0.0:1785393779.724633:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8107:x1872120807172992:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785393779.725407:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8107:x1872120807172992:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 773us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.725416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1785393779.736814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393779.736945:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173120 00000100:00100000:3.0:1785393779.736957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173120 00000100:00100000:3.0:1785393779.737037:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:3.0:1785393779.737049:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8107:x1872120807173120:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785393779.738518:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8107:x1872120807173120:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 1468us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393779.738528:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:1.0:1785393779.744077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.751937:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173248 00000100:00100000:0.0:1785393779.751966:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173248 00000100:00100000:0.0:1785393779.752209:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1785393779.752222:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8116:x1872120807173248:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785393779.754136:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8116:x1872120807173248:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 1900us (10056us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.754150:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1785393779.761415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393779.773257:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173376 00000100:00100000:3.0:1785393779.773278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173376 00000100:00100000:3.0:1785393779.773368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1785393779.773381:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8116:x1872120807173376:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785393779.773728:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:8116:x1872120807173376:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 349us (12327us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393779.773738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1785393779.779438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393779.779482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.779897:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173632 00000100:00100000:2.0:1785393779.779909:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173632 00000100:00100000:2.0:1785393779.779983:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173504 00000100:00100000:2.0:1785393779.779986:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173504 00000100:00100000:2.0:1785393779.780010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1785393779.780021:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807173632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393779.780142:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807173632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 122us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.780150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1785393779.780169:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1785393779.780174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1872120807173504:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1785393779.780199:0:5831:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 21cecf35-5d73-4c59-b498-ba47bfa21eb7@192.168.203.12@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1785393779.780237:0:5831:0:(genops.c:1406:class_connect()) connect: client 21cecf35-5d73-4c59-b498-ba47bfa21eb7, cookie 0xcc9b96d8b3629a83 00000004:00100000:2.0:1785393779.780273:0:5831:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1785393779.780622:0:5831:0:(import.c:65:import_set_state_nolock()) ffff93abc125d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785393779.780656:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2357:x1872120807173504:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 481us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.780664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785393779.791923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393779.791985:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.792113:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173760 00000100:00100000:0.0:1785393779.792137:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173760 00000100:00100000:2.0:1785393779.792190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807173888 00000100:00100000:2.0:1785393779.792195:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807173888 00000100:00100000:0.0:1785393779.792228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1785393779.792240:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+7:0:x1872120807173760:12345-192.168.203.12@tcp:41:mount.lustre.0 00000100:00080000:1.0:1785393779.792284:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1785393779.792359:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785393779.792457:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+7:0:x1872120807173760:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 219us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.792483:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1785393779.792502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1785393779.792508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807173888:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785393779.792519:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785393779.792540:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807173888:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.792547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785393779.800498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393779.800922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174016 00000100:00100000:3.0:1785393779.800934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174016 00000100:00100000:3.0:1785393779.800993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393779.801005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807174016:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:3.0:1785393779.801119:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807174016:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 116us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393779.801136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1785393779.804468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393779.804517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393779.804631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174400 00000100:00100000:0.0:1785393779.804642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174400 00000100:00100000:0.0:1785393779.804701:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785393779.804712:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807174400:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:0.0:1785393779.805095:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1785393779.805263:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:8107:x1872120807174400:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 551us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.805272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1785393779.806267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393779.823486:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174144 00000100:00100000:2.0:1785393779.823507:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174144 00000100:00100000:2.0:1785393779.823595:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174272 00000100:00100000:2.0:1785393779.823599:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174272 00000100:00100000:2.0:1785393779.823630:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1785393779.823640:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd7e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1872120807174144:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785393779.823680:0:6632:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 21cecf35-5d73-4c59-b498-ba47bfa21eb7@192.168.203.12@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1785393779.823719:0:6632:0:(genops.c:1406:class_connect()) connect: client 21cecf35-5d73-4c59-b498-ba47bfa21eb7, cookie 0xcc9b96d8b3629a8a 00002000:00100000:2.0:1785393779.823733:0:6632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 21cecf35-5d73-4c59-b498-ba47bfa21eb7/ffff93abc125a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785393779.823747:0:6632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1785393779.827091:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1785393779.827106:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1872120807174272:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1785393779.827160:0:6631:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 21cecf35-5d73-4c59-b498-ba47bfa21eb7@192.168.203.12@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1785393779.827196:0:6631:0:(genops.c:1406:class_connect()) connect: client 21cecf35-5d73-4c59-b498-ba47bfa21eb7, cookie 0xcc9b96d8b3629a91 00002000:00100000:0.0:1785393779.827210:0:6631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 21cecf35-5d73-4c59-b498-ba47bfa21eb7/ffff93acf769a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785393779.827223:0:6631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785393779.827509:0:6631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785393779.827545:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acf7699800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785393779.827798:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2357:x1872120807174272:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 692us (21535us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393779.827806:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00002000:00080000:2.0:1785393779.828261:0:6632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785393779.828287:0:6632:0:(import.c:65:import_set_state_nolock()) ffff93abc1259000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785393779.828315:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd7e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2357:x1872120807174144:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 4675us (23797us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393779.828323:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:3.0:1785393779.828681:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393780.832556:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393781.863011:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393782.891928:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785393782.964563:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000100:00100000:2.0:1785393783.329466:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831328256:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.329562:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393783.329657:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831328768:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.329683:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393783.329712:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785393783.329718:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831328384:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.329740:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393783.329757:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831328896:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.329779:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393783.329815:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328768 00000100:00100000:2.0:1785393783.329824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328768 00000100:00100000:2.0:1785393783.329881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328384 00000100:00100000:2.0:1785393783.329883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328384 00000100:00100000:2.0:1785393783.329901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393783.329909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831328768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.329962:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831328768:12345-0@lo:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393783.329969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393783.329988:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785393783.329994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831328384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.330016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831328384:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393783.330141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328256 00000100:00100000:0.0:1785393783.330146:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328256 00000100:00100000:1.0:1785393783.330217:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831328512:0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.330249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393783.330278:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393783.330291:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831328640:0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.330316:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393783.330349:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328896 00000100:00100000:1.0:1785393783.330353:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328896 00000100:00100000:1.0:1785393783.330385:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328640 00000100:00100000:1.0:1785393783.330388:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328640 00000100:00100000:1.0:1785393783.330406:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785393783.330412:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831328896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.330444:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831328896:12345-0@lo:400:kworker.0 Request processed in 32us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393783.330449:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785393783.330461:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785393783.330466:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.330493:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831328640:12345-0@lo:400:kworker.0 Request processed in 27us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393783.330499:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1785393783.330537:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8e00 x1872120831328640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393783.330552:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831328640:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.330695:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785393783.330707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831328512 00000100:00100000:2.0:1785393783.330710:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831328512 00000100:00100000:2.0:1785393783.330728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1785393783.330734:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831328512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.330778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831328512:12345-0@lo:400:kworker.0 Request processed in 43us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393783.330783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1785393783.330809:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393783.330814:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393783.330816:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393783.330842:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831328384:0@lo:400:kworker.0 00010000:00080000:2.0:1785393783.330853:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9f80 x1872120831328896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393783.330862:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831328896:0@lo:400:kworker.0 00000100:00100000:2.0:1785393783.330872:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831328768:0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.337160:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831328512:0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.344184:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1785393783.344207:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831328256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393783.344331:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831328256:12345-0@lo:400:kworker.0 Request processed in 131us (14768us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393783.344339:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1785393783.344428:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831328256:0@lo:400:kworker.0 00000001:00100000:0.0:1785393783.492528:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000100:00100000:0.0:1785393783.840293:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831329024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393783.840375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393783.842239:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329024 00000100:00100000:0.0:1785393783.842250:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329024 00000100:00100000:0.0:1785393783.842322:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785393783.842333:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831329024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785393783.843472:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393783.843545:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831329024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1213us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393783.843554:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1785393783.843620:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007bb480 x1872120831329024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393783.843641:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831329024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393783.905363:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785393783.942652:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000100:00100000:0.0:1785393784.351895:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831329152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393784.352002:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393784.352237:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329152 00000100:00100000:1.0:1785393784.352247:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329152 00000100:00100000:1.0:1785393784.352307:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785393784.352318:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831329152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393784.352363:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393784.352415:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831329152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393784.352423:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1785393784.352597:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8488e00 x1872120831329152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393784.352619:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831329152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393784.929661:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393785.049358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393785.049403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393785.049428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393785.049450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393785.049477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393785.049507:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174656 00000100:00100000:2.0:1785393785.049517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174656 00000100:00100000:2.0:1785393785.049620:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174784 00000100:00100000:2.0:1785393785.049624:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174784 00000100:00100000:2.0:1785393785.049654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1785393785.049665:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807174656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393785.049753:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807174656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393785.049761:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1785393785.049778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1785393785.049784:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807174784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393785.049899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807174784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 114us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393785.049906:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1785393785.049925:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175040 00000100:00100000:2.0:1785393785.049928:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175040 00000100:00100000:2.0:1785393785.049952:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174912 00000100:00100000:2.0:1785393785.049954:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174912 00000100:00100000:2.0:1785393785.049971:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1785393785.049977:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393785.050000:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393785.050006:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1785393785.050015:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1785393785.050020:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807174912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393785.050039:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807174912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393785.050045:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00080000:2.0:1785393785.050062:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393785.050071:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393785.050074:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393785.050375:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807174528 00000100:00100000:0.0:1785393785.050380:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807174528 00000100:00100000:0.0:1785393785.050417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:0.0:1785393785.050424:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807174528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393785.050464:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807174528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393785.050470:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00010000:00010000:3.0:1785393785.954393:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393786.993281:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393788.003790:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393788.469547:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831329280:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.469653:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.469711:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831329792:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.469772:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.469805:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785393788.469812:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831329408:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.469860:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.469879:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831329920:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.469908:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.470347:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831329536:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.470395:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393788.470400:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc848a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831329664:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470423:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393788.470492:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329280 00000100:00100000:1.0:1785393788.470502:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329280 00000100:00100000:1.0:1785393788.470554:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1785393788.470563:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831329280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470634:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831329280:12345-0@lo:400:kworker.0 Request processed in 71us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.470642:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1785393788.470677:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329792 00000100:00100000:1.0:1785393788.470696:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329792 00000100:00100000:1.0:1785393788.470729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329408 00000100:00100000:1.0:1785393788.470732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329408 00000100:00100000:1.0:1785393788.470743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329536 00000100:00100000:1.0:1785393788.470745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329536 00000100:00100000:1.0:1785393788.470759:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785393788.470765:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470798:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831329792:12345-0@lo:400:kworker.0 Request processed in 32us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.470805:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785393788.470816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393788.470822:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831329408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470846:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831329408:12345-0@lo:400:kworker.0 Request processed in 24us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.470852:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393788.470862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785393788.470867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.470898:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831329536:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.472114:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785393788.472147:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329920 00000100:00100000:1.0:1785393788.472151:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329920 00000100:00100000:1.0:1785393788.472227:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831329664 00000100:00100000:1.0:1785393788.472231:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831329664 00000100:00100000:1.0:1785393788.472255:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785393788.472262:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.472308:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831329920:12345-0@lo:400:kworker.0 Request processed in 46us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.472314:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785393788.472326:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785393788.472332:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.472363:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831329664:12345-0@lo:400:kworker.0 Request processed in 31us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393788.472370:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785393788.472454:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831329408:0@lo:400:kworker.0 00010000:00080000:1.0:1785393788.472469:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8488a80 x1872120831329920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393788.472479:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831329920:0@lo:400:kworker.0 00010000:00080000:0.0:1785393788.473642:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc848a300 x1872120831329664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393788.473653:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831329664:0@lo:400:kworker.0 00000100:00100000:0.0:1785393788.473665:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831329536:0@lo:400:kworker.0 00000100:00080000:0.0:1785393788.473695:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393788.473700:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393788.473703:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393788.475237:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc848a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831329280:0@lo:400:kworker.0 00000100:00100000:1.0:1785393788.475259:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831329792:0@lo:400:kworker.0 00000001:02000400:0.0:1785393788.814261:0:10207:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1785393788.961650:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831330048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393788.961732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393788.961818:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330048 00000100:00100000:3.0:1785393788.961828:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330048 00000100:00100000:3.0:1785393788.961875:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785393788.961893:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831330048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393788.961956:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393788.962005:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831330048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393788.962013:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1785393788.962446:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00211c00 x1872120831330048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393788.962468:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831330048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393789.031780:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393789.471810:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831330176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393789.471903:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393789.472161:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330176 00000100:00100000:0.0:1785393789.472171:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330176 00000100:00100000:0.0:1785393789.472272:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785393789.472283:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831330176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393789.472326:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393789.472385:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831330176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393789.472392:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1785393789.472462:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fe680 x1872120831330176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393789.472482:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831330176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393790.048707:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393790.147877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393790.147927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393790.147965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393790.147986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393790.148007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393790.148050:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175296 00000100:00100000:3.0:1785393790.148056:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175552 00000100:00100000:3.0:1785393790.148074:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175552 00000100:00100000:1.0:1785393790.148075:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175296 00000100:00100000:1.0:1785393790.148137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175424 00000100:00100000:1.0:1785393790.148147:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175424 00000100:00100000:3.0:1785393790.148259:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175680 00000100:00100000:3.0:1785393790.148263:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175680 00000100:00100000:3.0:1785393790.148291:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1785393790.148303:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393790.148399:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393790.148407:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1785393790.148423:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1785393790.148429:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393790.148452:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393790.148457:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1785393790.148475:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175168 00000100:00100000:3.0:1785393790.148478:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175168 00000100:00100000:3.0:1785393790.148959:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1785393790.148968:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807175168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393790.148995:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807175168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393790.149002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1785393790.149034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:3.0:1785393790.149040:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807175296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393790.149079:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807175296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393790.149085:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1785393790.156410:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1785393790.156427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393790.156529:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807175424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 106us (8541us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393790.156537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00080000:0.0:1785393790.162882:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393790.162899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393790.162902:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785393791.074661:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393792.103291:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393793.127376:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393793.572791:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831330432:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.572855:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393793.572912:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831330944:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.572934:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393793.573176:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831330304:0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.573208:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393793.573237:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831330816:0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.573256:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393793.573288:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330432 00000100:00100000:0.0:1785393793.573294:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330432 00000100:00100000:0.0:1785393793.573332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330816 00000100:00100000:0.0:1785393793.573335:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330816 00000100:00100000:0.0:1785393793.573356:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1785393793.573363:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831330432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.573404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831330432:12345-0@lo:400:kworker.0 Request processed in 41us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393793.573410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1785393793.573424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785393793.573429:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831330816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.573453:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831330816:12345-0@lo:400:kworker.0 Request processed in 24us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393793.573458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1785393793.573473:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393793.573497:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831330816:0@lo:400:kworker.0 00000100:00100000:1.0:1785393793.573619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330304 00000100:00100000:1.0:1785393793.573623:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330304 00000100:00100000:1.0:1785393793.573648:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1785393793.573654:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393793.573687:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831330304:12345-0@lo:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393793.573692:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1785393793.573761:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831330432:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.573779:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831330560:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.573801:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393793.573878:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831330304:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.574232:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393793.574239:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831330688:0@lo:400:kworker.0 00000100:00100000:2.0:1785393793.574262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393793.574325:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330944 00000100:00100000:0.0:1785393793.574330:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330944 00000100:00100000:0.0:1785393793.574357:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330688 00000100:00100000:0.0:1785393793.574360:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330688 00000100:00100000:0.0:1785393793.574391:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785393793.574396:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831330944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.574430:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831330944:12345-0@lo:400:kworker.0 Request processed in 33us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393793.574435:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785393793.574445:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785393793.574450:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831330688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393793.574475:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831330688:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393793.574480:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1785393793.574496:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393793.574498:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1785393793.574512:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a0380 x1872120831330688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393793.574523:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831330688:0@lo:400:kworker.0 00010000:00080000:0.0:1785393793.574540:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76a0e00 x1872120831330944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393793.574548:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831330944:0@lo:400:kworker.0 00000100:00100000:1.0:1785393793.577387:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831330560 00000100:00100000:1.0:1785393793.577399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831330560 00000100:00100000:1.0:1785393793.577457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1785393793.577465:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393793.577537:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831330560:12345-0@lo:400:kworker.0 Request processed in 72us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393793.577544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1785393793.577606:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393793.577635:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831330560:0@lo:400:kworker.0 00000100:00100000:2.0:1785393794.089787:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393794.089809:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad008f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831331072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393794.089886:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393794.090102:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331072 00000100:00100000:3.0:1785393794.090109:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331072 00000100:00100000:3.0:1785393794.090158:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785393794.090168:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831331072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393794.090210:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393794.090262:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831331072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393794.090269:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1785393794.090278:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad008f4a80 x1872120831331072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393794.090296:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad008f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831331072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393794.146146:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393794.596041:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831331200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393794.596150:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393794.596336:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331200 00000100:00100000:3.0:1785393794.596346:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331200 00000100:00100000:3.0:1785393794.596406:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785393794.596416:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831331200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393794.596462:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393794.596544:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831331200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393794.596552:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1785393794.596620:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad00210380 x1872120831331200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393794.596642:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831331200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393795.167792:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393795.272252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393795.272296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393795.272323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393795.272367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393795.272397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393795.272422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176064 00000100:00100000:3.0:1785393795.272430:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176064 00000100:00100000:3.0:1785393795.272472:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175936 00000100:00100000:3.0:1785393795.272474:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175936 00000100:00100000:3.0:1785393795.272489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1785393795.272497:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176064:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393795.272600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176064:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393795.272608:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:3.0:1785393795.272624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1785393795.272630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807175936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393795.272651:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807175936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393795.272657:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1785393795.272672:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176320 00000100:00100000:3.0:1785393795.272675:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176320 00000100:00100000:3.0:1785393795.272695:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176192 00000100:00100000:3.0:1785393795.272698:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176192 00000100:00100000:3.0:1785393795.272714:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1785393795.272719:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393795.272740:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393795.272745:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1785393795.272754:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1785393795.272759:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393795.272776:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 17us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393795.272781:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00080000:3.0:1785393795.272793:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393795.272796:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393795.272798:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393795.272962:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807175808 00000100:00100000:1.0:1785393795.272966:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807175808 00000100:00100000:1.0:1785393795.273001:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:1.0:1785393795.273007:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807175808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393795.273048:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807175808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393795.273054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00010000:00010000:1.0:1785393796.192640:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393797.221001:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393798.242554:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393798.689485:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831331456:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690677:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690734:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831331968:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690762:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690797:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785393798.690803:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831331328:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690827:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690844:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831331840:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690864:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690896:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831331584:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690916:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690931:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393798.690936:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831331712:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.690957:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393798.690982:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331456 00000100:00100000:1.0:1785393798.690988:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331456 00000100:00100000:1.0:1785393798.691027:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331840 00000100:00100000:1.0:1785393798.691030:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331840 00000100:00100000:1.0:1785393798.691048:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331584 00000100:00100000:1.0:1785393798.691051:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331584 00000100:00100000:1.0:1785393798.691082:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785393798.691090:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831331456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.691141:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831331456:12345-0@lo:400:kworker.0 Request processed in 52us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393798.691147:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785393798.691163:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1785393798.691168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831331840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.691194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831331840:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393798.691199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1785393798.691209:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785393798.691215:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.691243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831331584:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393798.691247:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785393798.691277:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831331584:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.691298:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831331840:0@lo:400:kworker.0 00000100:00100000:1.0:1785393798.691305:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831331456:0@lo:400:kworker.0 00000100:00100000:0.0:1785393798.691386:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331328 00000100:00100000:0.0:1785393798.691391:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331328 00000100:00100000:0.0:1785393798.691420:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785393798.691426:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831331328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393798.691458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831331328:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393798.691471:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785393798.691502:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831331328:0@lo:400:kworker.0 00000100:00100000:3.0:1785393798.691631:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331968 00000100:00100000:3.0:1785393798.691635:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331968 00000100:00100000:3.0:1785393798.691666:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831331712 00000100:00100000:3.0:1785393798.691668:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831331712 00000100:00100000:3.0:1785393798.691683:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785393798.691689:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393798.691727:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831331968:12345-0@lo:400:kworker.0 Request processed in 39us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393798.691732:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785393798.691741:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785393798.691746:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831331712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393798.691768:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831331712:12345-0@lo:400:kworker.0 Request processed in 23us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393798.691772:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1785393798.691787:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393798.691790:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393798.691792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785393798.695950:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fdf80 x1872120831331968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393798.695969:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831331968:0@lo:400:kworker.0 00010000:00080000:1.0:1785393798.699766:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8ff100 x1872120831331712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393798.699783:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831331712:0@lo:400:kworker.0 00000100:00100000:0.0:1785393799.203834:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393799.203918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393799.203977:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332096 00000100:00100000:2.0:1785393799.203985:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332096 00000100:00100000:2.0:1785393799.204046:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785393799.204057:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393799.204089:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393799.204131:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393799.204138:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1785393799.204434:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc889e300 x1872120831332096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393799.204452:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393799.264817:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393799.715759:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393799.715779:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393799.715849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393799.715917:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332224 00000100:00100000:0.0:1785393799.715923:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332224 00000100:00100000:0.0:1785393799.715972:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1785393799.715980:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393799.716725:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393799.716785:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 804us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393799.716794:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1785393799.717818:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8a80 x1872120831332224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393799.717839:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393800.287968:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393800.389967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393800.390031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393800.390059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393800.390085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393800.390107:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393800.390144:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176832 00000100:00100000:3.0:1785393800.390153:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176832 00000100:00100000:3.0:1785393800.390210:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176960 00000100:00100000:3.0:1785393800.390212:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176960 00000100:00100000:3.0:1785393800.390232:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785393800.390240:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2357:x1872120807176832:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1785393800.390266:0:6631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629a8a 00000100:00080000:3.0:1785393800.390273:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93abc1259000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393800.390316:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1785393800.390642:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+2:2357:x1872120807176832:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 402us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393800.390650:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785393800.390664:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1785393800.390827:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176448 00000100:00100000:0.0:1785393800.390831:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176448 00000100:00100000:0.0:1785393800.390855:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:0.0:1785393800.390867:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807176448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393800.390892:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807176448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393800.390898:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:1.0:1785393800.390963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176576 00000100:00100000:1.0:1785393800.390966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176576 00000100:00100000:1.0:1785393800.391008:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807176704 00000100:00100000:1.0:1785393800.391011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807176704 00000100:00100000:1.0:1785393800.391033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1785393800.391039:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807176576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393800.391064:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807176576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393800.391070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1785393800.391080:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1785393800.391085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393800.391101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807176704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 16us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393800.391106:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:3.0:1785393800.391364:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2357:x1872120807176960:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1785393800.391376:0:6631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629a91 00000100:00080000:3.0:1785393800.391381:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acf7699800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393800.391406:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1785393800.391598:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+2:2357:x1872120807176960:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 236us (1489us total) trans 0 rc 0/0 00010000:00010000:1.0:1785393800.391633:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393800.391937:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393800.391942:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393800.391944:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785393800.391963:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393800.398805:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1785393801.318835:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393802.335842:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393803.359671:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393803.844993:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831332480:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845059:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845117:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831332992:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845143:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845175:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785393803.845181:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831332352:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845225:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845261:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831332864:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845281:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845315:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831332608:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845352:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393803.845357:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332736:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845373:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393803.845399:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332480 00000100:00100000:3.0:1785393803.845405:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332480 00000100:00100000:3.0:1785393803.845435:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332864 00000100:00100000:3.0:1785393803.845437:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332864 00000100:00100000:3.0:1785393803.845454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332608 00000100:00100000:3.0:1785393803.845457:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332608 00000100:00100000:3.0:1785393803.845472:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785393803.845479:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831332480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831332480:12345-0@lo:400:kworker.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845535:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785393803.845552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785393803.845557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831332864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831332864:12345-0@lo:400:kworker.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785393803.845628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785393803.845633:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845661:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831332608:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785393803.845694:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332992 00000100:00100000:3.0:1785393803.845698:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332992 00000100:00100000:3.0:1785393803.845720:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332736 00000100:00100000:3.0:1785393803.845723:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332736 00000100:00100000:3.0:1785393803.845737:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785393803.845743:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831332992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845775:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831332992:12345-0@lo:400:kworker.0 Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845781:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785393803.845791:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785393803.845796:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845818:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831332736:12345-0@lo:400:kworker.0 Request processed in 22us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845823:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785393803.845837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831332352 00000100:00100000:3.0:1785393803.845840:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831332352 00000100:00100000:3.0:1785393803.845860:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1785393803.845865:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.845889:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831332352:12345-0@lo:400:kworker.0 Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393803.845895:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1785393803.845922:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393803.845926:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393803.845928:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785393803.845956:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff91a300 x1872120831332736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393803.845992:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831332736:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.846007:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831332608:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.846031:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831332352:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.846040:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831332864:0@lo:400:kworker.0 00000100:00100000:3.0:1785393803.846048:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831332480:0@lo:400:kworker.0 00010000:00080000:3.0:1785393803.846058:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff918700 x1872120831332992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393803.846066:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831332992:0@lo:400:kworker.0 00000001:00100000:2.0:1785393803.996559:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000020:00000080:2.0:1785393803.996586:0:7533:0:(genops.c:906:class_export_put()) final put ffff93acf769a800/21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000020:00000080:3.0:1785393803.996673:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf769a800/21cecf35-5d73-4c59-b498-ba47bfa21eb7 for lustre-OST0001 00000020:00000080:3.0:1785393803.996719:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf7699800 for lustre-OST0001 00000100:00100000:3.0:1785393804.319752:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393804.319781:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831333120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393804.321317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393804.321484:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333120 00000100:00100000:1.0:1785393804.321492:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333120 00000100:00100000:1.0:1785393804.321541:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1785393804.321549:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831333120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393804.321602:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393804.321653:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831333120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393804.321660:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1785393804.321697:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff918700 x1872120831333120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393804.321717:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831333120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393804.387295:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785393804.474654:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000020:00000080:1.0:1785393804.474674:0:6656:0:(genops.c:906:class_export_put()) final put ffff93abc125a000/21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000020:00000080:3.0:1785393804.475112:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc125a000/21cecf35-5d73-4c59-b498-ba47bfa21eb7 for lustre-OST0000 00000020:00000080:3.0:1785393804.475258:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc1259000 for lustre-OST0000 00000100:00100000:3.0:1785393804.833904:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393804.833924:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831333248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393804.833997:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393804.834139:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333248 00000100:00100000:0.0:1785393804.834146:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333248 00000100:00100000:0.0:1785393804.834246:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785393804.834256:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831333248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393804.834289:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393804.834413:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831333248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393804.834421:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1785393804.839056:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9f80 x1872120831333248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393804.839155:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831333248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393805.407729:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393805.508376:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393805.508412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393805.508440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393805.508466:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177344 00000100:00100000:2.0:1785393805.508474:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177344 00000100:00100000:2.0:1785393805.508525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177216 00000100:00100000:2.0:1785393805.508528:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177216 00000100:00100000:2.0:1785393805.508546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1785393805.508555:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807177344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393805.508656:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807177344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393805.508664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1785393805.508680:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1785393805.508687:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393805.508709:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393805.508716:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00080000:2.0:1785393805.508734:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393805.513372:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177088 00000100:00100000:1.0:1785393805.513382:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177088 00000100:00100000:1.0:1785393805.513443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:1.0:1785393805.513452:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807177088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393805.513517:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807177088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393805.513525:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00010000:00010000:2.0:1785393806.433846:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393807.457888:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393808.480698:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393808.929055:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393808.929121:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393808.929141:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831333504:0@lo:400:kworker.0 00000100:00100000:2.0:1785393808.929208:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393808.929263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333504 00000100:00100000:2.0:1785393808.929270:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333504 00000100:00100000:2.0:1785393808.929308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785393808.929315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831333504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393808.929359:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831333504:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393808.929365:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785393808.929401:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831333504:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.934022:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831333376:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.934095:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393808.934166:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333376 00000100:00100000:3.0:1785393808.936699:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333376 00000100:00100000:3.0:1785393808.936771:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1785393808.936779:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831333376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.936877:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831333376:12345-0@lo:400:kworker.0 Request processed in 98us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393808.936884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1785393808.936957:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831333376:0@lo:400:kworker.0 00000100:00100000:0.0:1785393808.937794:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831333760:0@lo:400:kworker.0 00000100:00100000:0.0:1785393808.937839:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393808.937863:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393808.937868:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831333632:0@lo:400:kworker.0 00000100:00100000:0.0:1785393808.937888:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393808.937926:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333632 00000100:00100000:0.0:1785393808.937931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333632 00000100:00100000:0.0:1785393808.937982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785393808.937988:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831333632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393808.938024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831333632:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393808.938045:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1785393808.938063:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393808.938085:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831333632:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938342:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333760 00000100:00100000:3.0:1785393808.938346:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333760 00000100:00100000:3.0:1785393808.938384:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1785393808.938390:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938427:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831333760:12345-0@lo:400:kworker.0 Request processed in 38us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393808.938434:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1785393808.938460:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8e00 x1872120831333760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393808.938471:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831333760:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938486:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831334016:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938507:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393808.938523:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393808.938528:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831333888:0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393808.938596:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334016 00000100:00100000:3.0:1785393808.938658:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334016 00000100:00100000:3.0:1785393808.938684:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785393808.938690:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938723:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831334016:12345-0@lo:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393808.938729:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785393808.938747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831333888 00000100:00100000:3.0:1785393808.938750:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831333888 00000100:00100000:3.0:1785393808.938769:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1785393808.938775:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393808.938803:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831333888:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393808.939669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1785393808.939709:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831333888:0@lo:400:kworker.0 00010000:00080000:3.0:1785393808.939720:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8a80 x1872120831334016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393808.939730:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831334016:0@lo:400:kworker.0 00000100:00080000:0.0:1785393808.939905:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393808.939909:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393808.939911:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393809.449210:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831334144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393809.449273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393809.449343:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334144 00000100:00100000:2.0:1785393809.449351:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334144 00000100:00100000:2.0:1785393809.449399:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785393809.449407:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831334144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393809.449438:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393809.449476:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831334144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393809.449483:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1785393809.449519:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b0b480 x1872120831334144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393809.449535:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831334144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393809.508125:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393809.952945:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831334272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393809.953034:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393809.953159:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334272 00000100:00100000:3.0:1785393809.953169:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334272 00000100:00100000:3.0:1785393809.953226:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1785393809.953236:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831334272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393809.953279:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393809.953339:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831334272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393809.953357:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1785393809.953436:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff91a300 x1872120831334272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393809.953459:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831334272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393810.527835:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393810.627052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393810.627158:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177600 00000100:00100000:0.0:1785393810.627176:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177600 00000100:00100000:0.0:1785393810.627251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1785393810.627261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393810.627325:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393810.627331:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00080000:1.0:1785393810.629736:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393810.632319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393810.632413:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177472 00000100:00100000:3.0:1785393810.632420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177472 00000100:00100000:3.0:1785393810.632468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1785393810.632477:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807177472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393810.632536:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807177472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393810.632543:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:0.0:1785393810.633566:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393810.633649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177728 00000100:00100000:3.0:1785393810.633654:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177728 00000100:00100000:3.0:1785393810.633694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1785393810.633701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807177728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393810.633741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807177728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393810.633748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00080000:1.0:1785393810.633821:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393811.552708:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393812.575768:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393813.601288:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393814.048327:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831334528:0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.048401:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.048488:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831335040:0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.048518:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.048595:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785393814.048604:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831334400:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.048631:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831334656:0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.048645:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.048678:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831334912:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.048710:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.048725:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335040 00000100:00100000:1.0:1785393814.048740:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335040 00000100:00100000:0.0:1785393814.048759:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393814.048771:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831334784:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.048806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.048814:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785393814.048827:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831335040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.048885:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831335040:12345-0@lo:400:kworker.0 Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393814.048892:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785393814.048917:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334784 00000100:00100000:1.0:1785393814.048932:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334784 00000100:00100000:1.0:1785393814.048958:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785393814.048965:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831334784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.048970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334528 00000100:00100000:0.0:1785393814.048980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334528 00000100:00100000:1.0:1785393814.049024:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831334784:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393814.049029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334656 00000100:00100000:1.0:1785393814.049036:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785393814.049036:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334656 00000100:00100000:0.0:1785393814.049067:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393814.049074:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334400 00000100:00100000:1.0:1785393814.049081:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334400 00000100:00100000:0.0:1785393814.049092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831334528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.049125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1785393814.049134:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831334400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.049173:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831334528:12345-0@lo:400:kworker.0 Request processed in 83us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393814.049183:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393814.049188:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831334400:12345-0@lo:400:kworker.0 Request processed in 53us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393814.049198:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1785393814.049211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1785393814.049222:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831334656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785393814.049233:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393814.049240:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393814.049243:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785393814.049268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831334656:12345-0@lo:400:kworker.0 Request processed in 48us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393814.049276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1785393814.049298:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b9f80 x1872120831334784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393814.049314:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831334784:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.049325:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393814.049346:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831334656:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.049373:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831334528:0@lo:400:kworker.0 00010000:00080000:0.0:1785393814.049392:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ad007b8380 x1872120831335040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393814.049402:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831335040:0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.049408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831334912 00000100:00100000:1.0:1785393814.049414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831334912 00000100:00100000:1.0:1785393814.049450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785393814.049456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831334912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393814.049499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831334912:12345-0@lo:400:kworker.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393814.049516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1785393814.049534:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393814.049680:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831334400:0@lo:400:kworker.0 00000100:00100000:0.0:1785393814.049693:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831334912:0@lo:400:kworker.0 00000100:00100000:2.0:1785393814.567701:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393814.567722:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393814.567786:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393814.568342:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335168 00000100:00100000:3.0:1785393814.568349:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335168 00000100:00100000:3.0:1785393814.568390:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785393814.568398:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831335168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393814.568430:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393814.568487:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831335168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393814.568494:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1785393814.568601:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff91a300 x1872120831335168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393814.568617:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831335168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393814.623776:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393815.072940:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393815.072961:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831335296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393815.073037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393815.073142:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335296 00000100:00100000:3.0:1785393815.073150:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335296 00000100:00100000:3.0:1785393815.073198:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785393815.073207:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831335296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393815.073244:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393815.073304:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831335296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393815.073311:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1785393815.073391:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc8488e00 x1872120831335296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393815.073409:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831335296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393815.659081:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393815.763602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393815.763645:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393815.763669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393815.763692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178112 00000100:00100000:1.0:1785393815.763700:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178112 00000100:00100000:1.0:1785393815.763769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177984 00000100:00100000:1.0:1785393815.763773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177984 00000100:00100000:1.0:1785393815.763792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1785393815.763799:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807178112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393815.763867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807178112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393815.763874:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1785393815.763899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1785393815.763906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393815.763931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807177984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393815.763937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00080000:1.0:1785393815.763968:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393815.764704:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807177856 00000100:00100000:2.0:1785393815.764709:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807177856 00000100:00100000:2.0:1785393815.764759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:2.0:1785393815.764767:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807177856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393815.764813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807177856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393815.764820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000001:02000400:2.0:1785393816.131135:0:10910:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1785393816.671722:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393817.697234:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393818.730607:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393819.171424:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831335680:0@lo:400:kworker.0 00000100:00100000:3.0:1785393819.171484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393819.171545:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393819.171551:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831335808:0@lo:400:kworker.0 00000100:00100000:3.0:1785393819.171587:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393819.171622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335680 00000100:00100000:3.0:1785393819.171628:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335680 00000100:00100000:3.0:1785393819.171672:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1785393819.171681:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831335680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.171862:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831335424:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.171902:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393819.171925:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831335936:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.171942:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393819.171957:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785393819.171969:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831335552:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.171989:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393819.171998:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831336064:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.172013:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393819.172050:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335424 00000100:00100000:0.0:1785393819.172053:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335424 00000100:00100000:0.0:1785393819.172078:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785393819.172084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.172117:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831335424:12345-0@lo:400:kworker.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393819.172123:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785393819.172149:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1785393819.172155:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1785393819.172169:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335808 00000100:00100000:0.0:1785393819.172172:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335808 00000100:00100000:0.0:1785393819.172192:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336064 00000100:00100000:0.0:1785393819.172194:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336064 00000100:00100000:0.0:1785393819.172210:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785393819.172216:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.172245:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831335808:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393819.172251:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785393819.172262:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785393819.172267:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831336064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.172289:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831336064:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393819.172295:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1785393819.172414:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fa680 x1872120831335808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393819.172427:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831335808:0@lo:400:kworker.0 00010000:00080000:0.0:1785393819.172453:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fbb80 x1872120831336064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393819.172462:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831336064:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.172469:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831335424:0@lo:400:kworker.0 00000100:00100000:3.0:1785393819.172638:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831335680:12345-0@lo:400:kworker.0 Request processed in 957us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393819.172644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1785393819.172656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335936 00000100:00100000:3.0:1785393819.172658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335936 00000100:00100000:3.0:1785393819.172672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831335552 00000100:00100000:3.0:1785393819.172674:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831335552 00000100:00100000:3.0:1785393819.172684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1785393819.172689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831335936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393819.172727:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831335936:12345-0@lo:400:kworker.0 Request processed in 38us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393819.172739:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1785393819.172853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785393819.172859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831335552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393819.172899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831335552:12345-0@lo:400:kworker.0 Request processed in 40us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393819.172905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1785393819.172921:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393819.172925:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393819.172927:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393819.173624:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831335680:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.173647:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831335552:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.173655:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831335936:0@lo:400:kworker.0 00000100:00100000:0.0:1785393819.679906:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393819.679969:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393819.680132:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336192 00000100:00100000:3.0:1785393819.680139:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336192 00000100:00100000:3.0:1785393819.680186:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1785393819.680194:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831336192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393819.680227:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393819.680273:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831336192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393819.680280:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1785393819.680355:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fb100 x1872120831336192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393819.680372:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831336192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393819.744856:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393820.195321:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831336320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393820.195384:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393820.195460:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336320 00000100:00100000:0.0:1785393820.195467:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336320 00000100:00100000:0.0:1785393820.195506:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1785393820.195514:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831336320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393820.195544:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393820.201239:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831336320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5716us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393820.201264:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1785393820.202234:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff918700 x1872120831336320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393820.202261:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831336320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393820.774728:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393820.867776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393820.867810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393820.867839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393820.867873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178240 00000100:00100000:1.0:1785393820.867882:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178240 00000100:00100000:1.0:1785393820.867926:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:1.0:1785393820.867935:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807178240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393820.867994:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807178240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393820.868001:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:3.0:1785393820.869479:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178496 00000100:00100000:3.0:1785393820.869487:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178496 00000100:00100000:3.0:1785393820.869540:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178368 00000100:00100000:3.0:1785393820.869543:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178368 00000100:00100000:3.0:1785393820.869603:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1785393820.869611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807178496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393820.869656:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807178496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393820.869664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1785393820.869836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1785393820.869847:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807178368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393820.869886:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807178368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (2046us total) trans 0 rc 0/0 00000100:00080000:1.0:1785393820.869965:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393820.877714:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000020:00000080:0.0:1785393821.154336:0:11059:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd38c0e5f0 20000000:00000080:0.0:1785393821.154351:0:11059:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acc8592c00 uarg=0000000000000000 20000000:01000000:0.0:1785393821.154380:0:11059:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785393821.154385:0:11059:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785393821.154390:0:11059:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1785393821.161919:0:11060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1785393821.162297:0:11059:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1785393821.173291:0:11059:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785393821.173317:0:11059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173335:0:11059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173343:0:11059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173350:0:11059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173359:0:11059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173367:0:11059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173374:0:11059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173412:0:11059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173438:0:11059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.173453:0:11059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336448:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393821.173620:0:11059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173629:0:11059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.173638:0:11059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336576:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393821.173665:0:11059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173673:0:11059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 18 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.173682:0:11059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336704:0@lo:104: 00000100:00100000:3.0:1785393821.173726:0:11059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785393821.173766:0:11059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173773:0:11059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 18 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.173781:0:11059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336832:0@lo:104: 00000100:00100000:3.0:1785393821.173800:0:11059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785393821.173829:0:11059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.173837:0:11059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 18 pid: 5826 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.173846:0:11059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336960:0@lo:104: 00000100:00100000:3.0:1785393821.173875:0:11059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393821.173886:0:11059:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785393821.175069:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336704 00000100:00100000:2.0:1785393821.175077:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336704 00000100:00100000:2.0:1785393821.175109:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336832 00000100:00100000:2.0:1785393821.175111:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336832 00000100:00100000:2.0:1785393821.175119:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831336960 00000100:00100000:2.0:1785393821.175121:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831336960 00000100:00100000:2.0:1785393821.175132:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393821.175139:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:11059:x1872120831336704:12345-0@lo:104: 00010000:00010000:2.0:1785393821.175151:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175217:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785393821.175223:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+5:11059:x1872120831336704:12345-0@lo:104: Request processed in 84us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.175230:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785393821.175244:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393821.175249:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:11059:x1872120831336832:12345-0@lo:104: 00010000:00010000:2.0:1785393821.175256:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175284:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785393821.175288:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:11059:x1872120831336832:12345-0@lo:104: Request processed in 39us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.175301:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785393821.175311:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785393821.175316:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11059:x1872120831336960:12345-0@lo:104: 00010000:00010000:2.0:1785393821.175323:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175351:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785393821.175356:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11059:x1872120831336960:12345-0@lo:104: Request processed in 40us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.175361:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1785393821.175374:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785393821.175379:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175386:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393821.175390:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175399:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393821.175406:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393821.175413:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393821.175439:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175445:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393821.175468:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175475:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d0200/0xcc9b96d8b3629a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a60 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175487:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785393821.175490:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175496:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393821.175499:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175505:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393821.175512:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393821.175517:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393821.175527:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175532:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393821.175537:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175543:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a52 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175551:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393821.175558:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175563:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0400 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393821.175566:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175598:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393821.175605:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393821.175610:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785393821.175621:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175626:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785393821.175639:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175646:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acff9f0400/0xcc9b96d8b3629a3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629a44 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175657:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393821.175659:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393821.175661:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393821.175666:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393821.175670:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393821.175680:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831337088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393821.175710:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393821.175742:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393821.175747:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831337216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393821.175766:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393821.175791:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831337344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393821.175810:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393821.175835:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337088 00000100:00100000:2.0:1785393821.175838:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337088 00010000:00010000:2.0:1785393821.175853:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 19 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393821.175884:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337216 00000100:00100000:2.0:1785393821.175887:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337216 00010000:00010000:2.0:1785393821.175896:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 20 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393821.175905:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337344 00000100:00100000:2.0:1785393821.175907:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337344 00010000:00010000:2.0:1785393821.175914:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 21 pid: 5826 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393821.175924:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785393821.175929:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd8efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3317:x1872120831337088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393821.175939:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393821.175943:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 21 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175951:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 21 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.175964:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393821.175992:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd8efec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+21:3317:x1872120831337088:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.175999:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785393821.176030:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393821.176035:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3317:x1872120831337216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393821.176041:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393821.176045:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 20 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.176054:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 20 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.176063:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393821.176078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3317:x1872120831337216:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.176083:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393821.176093:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393821.176097:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831337344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393821.176104:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393821.176107:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 19 pid: 5826 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.176116:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 19 pid: 5826 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.176123:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393821.176142:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831337344:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.176148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393821.176187:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831337344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393821.176205:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831337216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393821.176211:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831337088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393821.176489:0:11059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0044600/0xcc9b96d8b3629a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629a59 expref: 18 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.176500:0:11059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336704:0@lo:104: 00010000:00010000:3.0:1785393821.176508:0:11059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f1e00/0xcc9b96d8b3629a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629a4b expref: 17 pid: 5825 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.176515:0:11059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336832:0@lo:104: 00010000:00010000:3.0:1785393821.176523:0:11059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43000/0xcc9b96d8b3629a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629a3d expref: 16 pid: 5826 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.176530:0:11059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336960:0@lo:104: 00000100:00100000:1.0:1785393821.186698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393821.186834:0:11059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336448:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393821.186868:0:11059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11059:1872120831336576:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393821.186900:0:11059:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393821.187141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178624 00000100:00100000:2.0:1785393821.187147:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178624 00010000:00010000:2.0:1785393821.187177:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393821.187250:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1785393821.187259:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807178624:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393821.187272:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393821.187277:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.187288:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.187304:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b3629a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd566 expref: 13 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.187316:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393821.187360:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:2359:x1872120807178624:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 102us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393821.187367:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1785393821.191749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393821.196196:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178752 00000100:00100000:3.0:1785393821.196208:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178752 00010000:00010000:3.0:1785393821.198213:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393821.198284:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1785393821.198295:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:2359:x1872120807178752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393821.198309:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393821.198315:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198326:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198343:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b3629a67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd52e expref: 12 pid: 5824 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198359:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198368:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198383:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198390:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198397:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198404:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198420:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393821.198424:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198433:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198449:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198459:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393821.198508:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2359:x1872120807178752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 217us (6769us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393821.198516:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:3.0:1785393821.198548:0:11059:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198556:0:11059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393821.198563:0:11059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629a98 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393821.792668:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785393822.815698:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785393822.815706:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc8926000 from 7 10000000:01000000:0.0:1785393822.815710:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785393822.815739:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393822.815754:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.815765:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.815785:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.815810:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.815880:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.815954:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393822.816023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337472 00000100:00100000:2.0:1785393822.816043:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337472 00000100:00100000:2.0:1785393822.816095:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1785393822.816103:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831337472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785393822.816115:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393822.816128:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629a9f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393822.816151:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393822.816162:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393822.816172:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393822.816217:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393822.816224:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1785393822.816258:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393822.816272:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.816281:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.816338:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.816362:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.816387:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393822.816436:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337600 00000100:00100000:1.0:1785393822.816440:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337600 00000100:00100000:1.0:1785393822.816468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1785393822.816474:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393822.816737:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393822.816744:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1785393822.817223:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.817253:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.817288:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.817320:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393822.817917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337728 00000100:00100000:2.0:1785393822.817923:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337728 00000100:00100000:2.0:1785393822.817969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1785393822.817977:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393822.818347:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 369us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393822.818355:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1785393822.835675:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785393822.837288:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785393822.837533:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785393822.837589:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393822.837609:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.837621:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393822.837630:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785393822.837633:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc825e800 from 7 10000000:01000000:0.0:1785393822.837636:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785393822.837670:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.837678:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.837688:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.837731:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.837992:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.838036:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393822.838096:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337856 00000100:00100000:1.0:1785393822.838102:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337856 00000100:00100000:1.0:1785393822.838141:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1785393822.838147:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831337856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393822.838158:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393822.838167:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629aad expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393822.838183:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393822.838190:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393822.838196:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42e00, rc 0) 00000100:00100000:1.0:1785393822.838228:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831337856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393822.838234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1785393822.838311:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393822.838324:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.838333:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.838441:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.838466:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.838520:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393822.838538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831337984 00000100:00100000:3.0:1785393822.838543:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831337984 00000100:00100000:3.0:1785393822.838604:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1785393822.838612:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831337984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393822.838961:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831337984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393822.838974:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1785393822.839029:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831337984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.839049:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.839079:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.839108:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393822.839154:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338112 00000100:00100000:1.0:1785393822.839158:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338112 00000100:00100000:1.0:1785393822.839178:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1785393822.839185:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831338112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393822.839320:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831338112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393822.839326:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1785393822.839428:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785393822.842890:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785393822.842962:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785393822.842980:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393822.842990:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.843001:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393822.843024:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785393822.843026:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ace0136800 from 7 10000000:01000000:0.0:1785393822.843028:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785393822.843075:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.843082:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.843092:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.843112:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.843171:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.843210:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1785393822.843306:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338240 00000100:00100000:3.0:1785393822.843317:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338240 00000100:00100000:3.0:1785393822.843361:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1785393822.843378:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831338240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393822.843390:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393822.843403:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629abb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.843423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.843433:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.843442:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0800, rc 0) 00000100:00100000:3.0:1785393822.843496:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831338240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393822.843903:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393822.843918:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393822.843927:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.843971:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.843995:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.844021:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1785393822.844082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1785393822.844108:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338368 00000100:00100000:3.0:1785393822.844112:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338368 00000100:00100000:3.0:1785393822.844125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1785393822.844131:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831338368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393822.849309:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831338368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5168us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393822.849322:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1785393822.849406:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.849456:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393822.849504:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393822.849543:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace00e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1785393822.849628:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338496 00000100:00100000:2.0:1785393822.849636:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338496 00000100:00100000:2.0:1785393822.849701:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1785393822.849710:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831338496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393822.849880:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831338496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393822.849887:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1785393822.849952:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831338496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785393822.853454:0:11074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1785393822.854178:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1785393822.854208:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785393822.854219:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393822.854231:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393822.989510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393822.998255:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807178880 00000100:00100000:3.0:1785393822.998276:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807178880 00000100:00100000:3.0:1785393822.998333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1785393822.998342:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:5582:x1872120807178880:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393822.998359:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393822.998374:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd590 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.998400:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.998412:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393822.998421:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1200, rc 0) 00000100:00100000:3.0:1785393822.998473:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807178880:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 132us (8972us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393822.998480:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:2.0:1785393823.006615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393823.008256:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179008 00000100:00100000:1.0:1785393823.008268:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179008 00000100:00100000:1.0:1785393823.008323:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:1.0:1785393823.008345:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807179008:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393823.008624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807179008:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 280us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393823.008632:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:1.0:1785393823.024442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393823.024969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179136 00000100:00100000:2.0:1785393823.024979:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179136 00000100:00100000:2.0:1785393823.025034:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:2.0:1785393823.025045:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807179136:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393823.025252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807179136:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 207us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393823.025259:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:2.0:1785393823.038083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393823.039896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179264 00000100:00100000:3.0:1785393823.039907:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179264 00000100:00100000:3.0:1785393823.039967:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:3.0:1785393823.039977:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807179264:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393823.039995:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393823.040012:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd597 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393823.040040:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393823.040052:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393823.040071:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0200, rc 0) 00000100:00100000:3.0:1785393823.040135:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807179264:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 160us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393823.040142:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:2.0:1785393823.045079:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393823.045170:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179392 00000100:00100000:3.0:1785393823.045180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179392 00000100:00100000:3.0:1785393823.045941:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:3.0:1785393823.045951:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807179392:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393823.046208:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807179392:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 258us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393823.046215:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:2.0:1785393823.049481:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393823.049565:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179520 00000100:00100000:1.0:1785393823.049602:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179520 00000100:00100000:1.0:1785393823.049646:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:1.0:1785393823.049655:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807179520:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393823.049842:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807179520:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 188us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393823.049857:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00010000:00010000:0.0:1785393823.845801:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393824.288921:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831338624:0@lo:400:kworker.0 00000100:00100000:1.0:1785393824.288990:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393824.289057:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831339136:0@lo:400:kworker.0 00000100:00100000:1.0:1785393824.289082:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393824.289108:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393824.289114:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831339008:0@lo:400:kworker.0 00000100:00100000:1.0:1785393824.289148:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393824.289179:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339136 00000100:00100000:1.0:1785393824.289185:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339136 00000100:00100000:1.0:1785393824.289246:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1785393824.289255:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831339136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393824.289303:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831339136:12345-0@lo:400:kworker.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393824.289332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1785393824.289462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338624 00000100:00100000:0.0:1785393824.289466:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338624 00000100:00100000:0.0:1785393824.289494:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1785393824.289500:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831338624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393824.289534:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831338624:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393824.289540:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:0.0:1785393824.289594:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393824.289607:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339008 00000100:00100000:0.0:1785393824.289611:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339008 00000100:00100000:0.0:1785393824.289640:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785393824.289647:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831339008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393824.289698:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831339008:12345-0@lo:400:kworker.0 Request processed in 44us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393824.289703:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1785393824.289719:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785393824.289757:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a4a80 x1872120831339008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393824.289770:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831339008:0@lo:400:kworker.0 00000100:00100000:0.0:1785393824.289778:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831338624:0@lo:400:kworker.0 00000100:00100000:0.0:1785393824.289795:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831339136:0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290644:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831338752:0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290687:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393824.290710:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831339264:0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290729:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393824.290758:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393824.290765:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831338880:0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290787:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393824.290827:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338752 00000100:00100000:2.0:1785393824.290832:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338752 00000100:00100000:2.0:1785393824.290865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831338880 00000100:00100000:2.0:1785393824.290868:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831338880 00000100:00100000:2.0:1785393824.290891:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1785393824.290897:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831338752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290934:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831338752:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393824.290940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1785393824.290954:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785393824.290960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.290985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831338880:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393824.290992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785393824.291006:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339264 00000100:00100000:2.0:1785393824.291009:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339264 00000100:00100000:2.0:1785393824.291027:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785393824.291032:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.291055:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831339264:12345-0@lo:400:kworker.0 Request processed in 23us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393824.291060:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1785393824.291073:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393824.291075:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393824.291091:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831338880:0@lo:400:kworker.0 00000100:00100000:2.0:1785393824.291147:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831338752:0@lo:400:kworker.0 00010000:00080000:2.0:1785393824.291156:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a5f80 x1872120831339264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393824.291165:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831339264:0@lo:400:kworker.0 00000100:00100000:0.0:1785393824.802711:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393824.802738:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831339392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393824.802795:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393824.803517:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339392 00000100:00100000:0.0:1785393824.803524:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339392 00000100:00100000:0.0:1785393824.803561:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785393824.803583:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831339392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785393824.803616:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393824.803657:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831339392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393824.803669:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1785393824.803710:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a4380 x1872120831339392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393824.803737:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831339392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393824.864332:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393825.312166:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831339520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393825.312229:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393825.312293:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339520 00000100:00100000:0.0:1785393825.312299:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339520 00000100:00100000:0.0:1785393825.312334:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785393825.312341:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831339520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393825.312372:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393825.312404:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831339520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393825.312410:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1785393825.312472:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a4380 x1872120831339520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393825.312497:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831339520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393825.892003:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393825.994471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393825.994509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393825.994541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393825.994585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179904 00000100:00100000:2.0:1785393825.994594:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179904 00000100:00100000:2.0:1785393825.994650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179776 00000100:00100000:2.0:1785393825.994667:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179776 00000100:00100000:2.0:1785393825.994697:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1785393825.994708:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807179904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393825.994801:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807179904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393825.994810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1785393825.994838:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1785393825.994846:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807179776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393825.994872:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807179776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393825.994878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00080000:2.0:1785393825.994899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393825.996873:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807179648 00000100:00100000:1.0:1785393825.996882:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807179648 00000100:00100000:1.0:1785393825.996929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:1.0:1785393825.996937:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807179648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393825.996997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807179648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393825.997003:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00010000:00010000:1.0:1785393826.934437:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785393827.922427:0:11256:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785393827.935761:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393828.959869:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393829.408110:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831339776:0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408214:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393829.408279:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831340288:0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408304:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393829.408338:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393829.408356:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831339904:0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408377:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393829.408407:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339776 00000100:00100000:2.0:1785393829.408415:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339776 00000100:00100000:2.0:1785393829.408463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339904 00000100:00100000:2.0:1785393829.408465:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339904 00000100:00100000:2.0:1785393829.408494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1785393829.408504:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408560:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831339776:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393829.408598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1785393829.408617:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1785393829.408623:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831339904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408660:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831339904:12345-0@lo:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393829.408665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1785393829.408684:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340288 00000100:00100000:2.0:1785393829.408687:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340288 00000100:00100000:2.0:1785393829.408719:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785393829.408726:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831340288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408757:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831340288:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393829.408763:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1785393829.408794:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393829.408799:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393829.408848:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831339904:0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.408859:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831339776:0@lo:400:kworker.0 00010000:00080000:2.0:1785393829.408870:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff98ce00 x1872120831340288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393829.408882:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831340288:0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409496:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831340032:0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409532:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393829.409600:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1785393829.409606:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831339648:0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393829.409673:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831340160:0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409692:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393829.409715:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831339648 00000100:00100000:3.0:1785393829.409720:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831339648 00000100:00100000:3.0:1785393829.409749:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1785393829.409756:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831339648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409829:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831339648:12345-0@lo:400:kworker.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393829.409836:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1785393829.409873:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831339648:0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409888:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340160 00000100:00100000:3.0:1785393829.409891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340160 00000100:00100000:3.0:1785393829.409918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1785393829.409923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831340160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393829.409955:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831340160:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393829.409961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1785393829.409974:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393829.409989:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831340160:0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.420059:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340032 00000100:00100000:2.0:1785393829.420078:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340032 00000100:00100000:2.0:1785393829.420175:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785393829.420186:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831340032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393829.420301:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831340032:12345-0@lo:400:kworker.0 Request processed in 117us (10769us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393829.420308:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1785393829.425066:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785393829.425608:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93abc3b09f80 x1872120831340032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393829.425645:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831340032:0@lo:400:kworker.0 00000100:00100000:1.0:1785393829.922163:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393829.922245:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393829.922370:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340416 00000100:00100000:3.0:1785393829.922380:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340416 00000100:00100000:3.0:1785393829.922456:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785393829.922466:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831340416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393829.922505:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393829.922564:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831340416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393829.922591:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1785393829.922696:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8f8700 x1872120831340416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393829.922719:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831340416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393829.983912:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393830.435982:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831340544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393830.436073:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393830.440858:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340544 00000100:00100000:1.0:1785393830.440878:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340544 00000100:00100000:1.0:1785393830.440964:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785393830.440975:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831340544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393830.441026:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393830.441132:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831340544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393830.441141:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1785393830.442990:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff9b6680 x1872120831340544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393830.443019:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831340544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393831.007805:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393831.107327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393831.107397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393831.107434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393831.107517:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180032 00000100:00100000:1.0:1785393831.107521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180160 00000100:00100000:3.0:1785393831.107530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180032 00000100:00100000:1.0:1785393831.107534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180160 00000100:00100000:3.0:1785393831.107630:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:3.0:1785393831.107645:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807180032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393831.107657:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180288 00000100:00100000:1.0:1785393831.107661:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180288 00000100:00100000:1.0:1785393831.107693:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1785393831.107705:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807180160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393831.107738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807180032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393831.107748:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:1.0:1785393831.107785:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807180160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393831.107799:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1785393831.107824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:1.0:1785393831.107835:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807180288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393831.107861:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807180288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393831.107868:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00080000:2.0:1785393831.108276:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393832.034460:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393833.057552:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393834.087761:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393834.528394:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831340800:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.528477:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393834.528533:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831341312:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.528556:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393834.528609:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393834.528615:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831340928:0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.528681:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831340672:0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.528725:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393834.528752:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831341184:0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.528791:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831341056:0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.528833:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393834.528878:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341312 00000100:00100000:2.0:1785393834.528886:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341312 00000100:00100000:2.0:1785393834.528951:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341056 00000100:00100000:2.0:1785393834.528954:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341056 00000100:00100000:2.0:1785393834.528978:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785393834.528986:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831341312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.529036:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831341312:12345-0@lo:400:kworker.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393834.529043:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785393834.529059:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785393834.529064:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831341056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.529087:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831341056:12345-0@lo:400:kworker.0 Request processed in 23us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393834.529093:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785393834.529118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340672 00000100:00100000:2.0:1785393834.529121:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340672 00000100:00100000:2.0:1785393834.529156:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1785393834.529162:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831340672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.529194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831340672:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393834.529200:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1785393834.529237:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393834.529241:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785393834.529276:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a7b80 x1872120831341056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393834.529292:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831341056:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.539879:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1785393834.539992:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf75a7480 x1872120831341312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393834.540011:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831341312:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540058:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340800 00000100:00100000:0.0:1785393834.540065:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340800 00000100:00100000:0.0:1785393834.540120:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831340928 00000100:00100000:0.0:1785393834.540123:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831340928 00000100:00100000:0.0:1785393834.540153:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785393834.540162:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540243:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831340800:12345-0@lo:400:kworker.0 Request processed in 81us (11766us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393834.540263:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785393834.540280:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1785393834.540285:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831340928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540310:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831340928:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393834.540316:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1785393834.540337:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393834.540355:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831340928:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540365:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831340800:0@lo:400:kworker.0 00000100:00100000:2.0:1785393834.540536:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393834.540606:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831340672:0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540722:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341184 00000100:00100000:0.0:1785393834.540727:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341184 00000100:00100000:0.0:1785393834.540798:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1785393834.540805:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393834.540839:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831341184:12345-0@lo:400:kworker.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393834.541680:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1785393834.542679:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393834.543143:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831341184:0@lo:400:kworker.0 00000001:02000400:3.0:1785393834.728488:0:11357:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:43:51 (1785393831) === 00000100:00100000:3.0:1785393835.043793:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831341440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393835.043875:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393835.043964:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341440 00000100:00100000:3.0:1785393835.043972:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341440 00000100:00100000:3.0:1785393835.044017:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785393835.044026:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831341440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393835.044068:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393835.044109:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831341440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393835.044116:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1785393835.044156:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fa300 x1872120831341440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393835.044194:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831341440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393835.107466:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393835.133652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393835.133710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.133801:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180416 00000100:00100000:0.0:1785393835.133814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180416 00000100:00100000:3.0:1785393835.133915:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180544 00000100:00100000:3.0:1785393835.133919:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180544 00000100:00100000:3.0:1785393835.133972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1785393835.133985:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9669:x1872120807180544:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:1.0:1785393835.134014:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1785393835.134026:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2361:x1872120807180416:12345-192.168.203.12@tcp:41:mkdir.0 00000004:00000024:1.0:1785393835.134065:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1785393835.134099:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9669:x1872120807180544:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 115us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393835.134108:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785393835.134124:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807180416:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 100us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393835.134133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:2.0:1785393835.134177:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393835.142958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.143198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180800 00000100:00100000:0.0:1785393835.143224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180800 00000100:00100000:0.0:1785393835.143310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1785393835.143334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:9669:x1872120807180800:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:0.0:1785393835.143410:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393835.147266:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b36299b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd519 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.147306:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc3c44b00) 00010000:00010000:0.0:1785393835.147332:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393835.148810:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.148826:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.148835:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.148867:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.148874:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.148880:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393835.165792:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1785393835.165818:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165827:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165833:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165838:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.165842:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165849:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165863:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14300) 00010000:00010000:1.0:1785393835.165866:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.165870:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.165875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044200/0xcc9b96d8b3629ad7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393835.169834:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002548f1ad reply state 00000000747e2c8d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393835.169854:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393835.170422:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9669:x1872120807180800:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 27086us (27685us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1785393835.170433:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:0.0:1785393835.177008:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177027:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177034:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177040:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.177044:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177065:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177081:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93acc7d14000) 00010000:00010000:0.0:1785393835.177084:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393835.177088:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.177094:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629ade lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393835.182901:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.183018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807180928 00000100:00100000:0.0:1785393835.183030:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807180928 00000100:00100000:0.0:1785393835.183097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1785393835.183108:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:9670:x1872120807180928:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:0.0:1785393835.183136:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393835.183163:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd59e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183239:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183255:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183266:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393835.183390:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1785393835.183400:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393835.183449:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183476:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd59e expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183496:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd59e expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.183505:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14900) 00010000:00010000:0.0:1785393835.183508:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393835.183512:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044a00, rc 0) 00000100:00100000:0.0:1785393835.184357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9670:x1872120807180928:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 464us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.184366:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1785393835.187047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.187142:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807181184 00000100:00100000:3.0:1785393835.187153:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807181184 00000100:00100000:3.0:1785393835.187206:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1785393835.187215:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9670:x1872120807181184:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:3.0:1785393835.187267:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393835.187293:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629aec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd59e expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.189422:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14900) 00010000:00010000:3.0:1785393835.189442:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393835.189477:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.189493:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.189505:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785393835.189902:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b706e874 reply state 00000000ae22ff47 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393835.189913:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785393835.189929:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1785393835.190035:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:9670:x1872120807181184:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 2818us (2992us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785393835.190050:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00010000:1.0:1785393835.192954:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.192970:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.192977:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.192983:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.192988:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.192996:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.193012:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785393835.193015:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785393835.193020:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.193027:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629af3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393835.217901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.220414:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807181312 00000100:00100000:0.0:1785393835.220428:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807181312 00000100:00100000:0.0:1785393835.220504:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1785393835.220515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9671:x1872120807181312:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:0.0:1785393835.220545:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393835.220614:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5a5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220693:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220708:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220740:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393835.220821:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1785393835.220827:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393835.220869:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220897:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5a5 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220918:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5a5 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.220927:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393835.220930:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393835.220933:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045400, rc 0) 00000100:00100000:0.0:1785393835.220994:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:9671:x1872120807181312:12345-192.168.203.12@tcp:101:chown.0 Request processed in 481us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.221002:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785393835.232964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393835.233059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807181440 00000100:00100000:1.0:1785393835.233072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807181440 00000100:00100000:1.0:1785393835.233144:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1785393835.233156:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:9671:x1872120807181440:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:1.0:1785393835.233181:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393835.233207:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629b08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5ac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233308:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233325:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233339:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233356:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233364:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233371:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233506:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233515:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233522:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393835.233797:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1785393835.233802:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393835.233836:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233863:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233870:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233877:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233884:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.233889:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233897:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233912:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:1.0:1785393835.233915:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.233920:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233927:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233939:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233945:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233951:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233964:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.233967:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233974:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233982:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93acc3c44e00) 00010000:00010000:1.0:1785393835.233984:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.233987:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.233993:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629b16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.234030:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629b08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ac expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.234045:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ac expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.234053:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc3c44300) 00010000:00010000:1.0:1785393835.234055:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393835.234059:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42600, rc 0) 00000100:00100000:1.0:1785393835.234125:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:9671:x1872120807181440:12345-192.168.203.12@tcp:101:chown.0 Request processed in 972us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393835.234133:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1785393835.237949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.238032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807181696 00000100:00100000:0.0:1785393835.238043:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807181696 00000100:00100000:0.0:1785393835.238100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1785393835.238111:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:9671:x1872120807181696:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:0.0:1785393835.238172:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393835.238198:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ac expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.238237:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc3c44300) 00010000:00010000:0.0:1785393835.238249:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393835.238288:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.238299:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.238307:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785393835.363194:0:5832:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026558ab5 reply state 000000003436d93b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393835.363215:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785393835.363420:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785393835.363558:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:9671:x1872120807181696:12345-192.168.203.12@tcp:36:chown.0 Request processed in 125442us (125613us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1785393835.363569:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000001:00080000:1.0:1785393835.364134:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1785393835.364244:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364255:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364264:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364270:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.364276:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364284:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364303:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14b00) 00010000:00010000:0.0:1785393835.364307:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785393835.364312:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.364325:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393835.397997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.398198:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807181824 00000100:00100000:0.0:1785393835.398211:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807181824 00000100:00100000:0.0:1785393835.398278:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1785393835.398289:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:9672:x1872120807181824:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1785393835.398322:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393835.398347:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5b3 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785393835.401613:0:10972:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3206us 00010000:00010000:0.0:1785393835.441563:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.441614:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.441632:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.441651:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.441659:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.441665:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442127:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442144:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442152:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393835.442234:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785393835.442239:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393835.442325:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442340:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442348:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442355:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442362:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.442366:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442374:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442387:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393835.442390:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393835.442395:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442410:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442422:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442671:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442678:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442684:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.442688:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442695:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442704:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93acc7d14b00) 00010000:00010000:0.0:1785393835.442707:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393835.442710:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442717:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629b39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442776:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5b3 expref: 8 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442793:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5b3 expref: 7 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.442808:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:0.0:1785393835.442811:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1785393835.442813:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044a00, rc 0) 00000100:00100000:0.0:1785393835.442954:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9672:x1872120807181824:12345-192.168.203.12@tcp:101:touch.500 Request processed in 44664us (44967us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.442965:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1785393835.451210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393835.451290:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182080 00000100:00100000:2.0:1785393835.451301:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182080 00000100:00100000:2.0:1785393835.451381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1785393835.451392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9672:x1872120807182080:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1785393835.451880:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.451953:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b3629b47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5ba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.452319:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.452337:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.452351:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.456893:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.458291:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.458457:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785393835.462395:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1785393835.469098:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469124:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469140:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469195:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469203:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469229:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469236:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393835.469241:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469250:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469264:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:2.0:1785393835.469267:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393835.469272:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469279:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629b4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393835.469295:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016e53827 reply state 00000000b4f1ad9d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393835.469306:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785393835.469357:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b3629b47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ba expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469374:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ba expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.469383:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acc89f9500) 00010000:00010000:2.0:1785393835.469385:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393835.469394:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:2.0:1785393835.469488:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:9672:x1872120807182080:12345-192.168.203.12@tcp:101:touch.500 Request processed in 18096us (18290us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1785393835.469498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:1.0:1785393835.483467:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483487:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483495:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483502:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.483507:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483515:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483534:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff93acd8302c00) 00010000:00010000:1.0:1785393835.483537:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.483542:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.483548:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0c00/0xcc9b96d8b3629b55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393835.501916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.502009:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182336 00000100:00100000:3.0:1785393835.502024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182336 00000100:00100000:3.0:1785393835.502103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1785393835.502115:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:9672:x1872120807182336:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:3.0:1785393835.502193:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393835.502226:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5ba expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.502249:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acc89f9500) 00010000:00010000:3.0:1785393835.502267:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393835.502321:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.502337:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.502348:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785393835.502552:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000673dff8b reply state 00000000dc49b27a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393835.502562:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393835.502731:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:9672:x1872120807182336:12345-192.168.203.12@tcp:36:touch.500 Request processed in 618us (828us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1785393835.502741:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:2.0:1785393835.508277:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508299:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508309:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508316:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393835.508321:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508330:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508349:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acd8302900) 00010000:00010000:2.0:1785393835.508353:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393835.508358:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.508364:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b3629b6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393835.508930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.509653:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182464 00000100:00100000:3.0:1785393835.509665:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182464 00000100:00100000:3.0:1785393835.509739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1785393835.509749:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:9672:x1872120807182464:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:3.0:1785393835.509788:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.509811:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629b71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5c1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.509892:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.509907:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.509927:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acd8302800) 00010000:00010000:3.0:1785393835.509930:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785393835.509932:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0400, rc 0) 00000100:00100000:3.0:1785393835.510006:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:9672:x1872120807182464:12345-192.168.203.12@tcp:101:touch.500 Request processed in 257us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393835.510015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785393835.513999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393835.515417:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182592 00000100:00100000:2.0:1785393835.515429:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182592 00000100:00100000:0.0:1785393835.515512:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1785393835.515532:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1872120807182592:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:0.0:1785393835.515597:0:6631:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:0.0:1785393835.515644:0:6631:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b3629b78 00002000:00100000:0.0:1785393835.515659:0:6631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93acc830b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785393835.515691:0:6631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785393835.515985:0:6631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785393835.516023:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acc830d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785393835.516106:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807182592:12345-192.168.203.12@tcp:8:touch.500 Request processed in 584us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.516115:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1785393835.517858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393835.517913:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182720 00000100:00100000:2.0:1785393835.517921:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182720 00000100:00100000:2.0:1785393835.518012:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1785393835.518023:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:0:x1872120807182720:12345-192.168.203.12@tcp:2:touch.500 00000100:00080000:0.0:1785393835.519553:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393835.553744:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393835.553787:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831341568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393835.553904:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393835.553998:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341568 00000100:00100000:1.0:1785393835.554007:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341568 00000100:00100000:1.0:1785393835.554062:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785393835.554071:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831341568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393835.554099:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393835.554142:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831341568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393835.554149:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1785393835.554194:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff9b5180 x1872120831341568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393835.554213:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831341568:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1785393835.594242:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000001:00080000:3.0:1785393835.594372:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1785393835.594747:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:0:x1872120807182720:12345-192.168.203.12@tcp:2:touch.500 Request processed in 76718us (76884us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1785393835.594760:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1785393835.599085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.599202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807182976 00000100:00100000:0.0:1785393835.599214:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807182976 00000100:00100000:0.0:1785393835.599285:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1785393835.599297:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:9672:x1872120807182976:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:0.0:1785393835.600055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:9672:x1872120807182976:12345-192.168.203.12@tcp:35:touch.500 Request processed in 756us (979us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1785393835.600080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1785393835.610492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.611005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807183104 00000100:00100000:3.0:1785393835.611018:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807183104 00000100:00100000:3.0:1785393835.611077:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1785393835.611088:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:9673:x1872120807183104:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1785393835.611119:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.611142:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5c8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611237:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611252:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611277:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393835.611346:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785393835.611350:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393835.611391:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611419:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c8 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611451:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c8 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.611461:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:3.0:1785393835.611464:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785393835.611468:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785393835.611541:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:9673:x1872120807183104:12345-192.168.203.12@tcp:101:rm.0 Request processed in 455us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393835.611549:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785393835.643159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.643395:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807183360 00000100:00100000:3.0:1785393835.643408:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807183360 00000100:00100000:3.0:1785393835.643494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1785393835.643506:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:9673:x1872120807183360:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1785393835.643727:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.643754:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393835.644078:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1785393835.644267:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629b8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5cf expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.644285:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393835.644288:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785393835.644293:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5cf expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.644309:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1e00, rc 0) 00000100:00100000:0.0:1785393835.644386:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:9673:x1872120807183360:12345-192.168.203.12@tcp:101:rm.0 Request processed in 882us (1239us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1785393835.644393:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1785393835.656163:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.656278:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807183488 00000100:00100000:0.0:1785393835.656289:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807183488 00000100:00100000:0.0:1785393835.656356:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1785393835.656368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:9673:x1872120807183488:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:0.0:1785393835.682188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:9673:x1872120807183488:12345-192.168.203.12@tcp:37:rm.0 Request processed in 25806us (26022us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.682206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1785393835.689060:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393835.692793:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807183744 00000100:00100000:1.0:1785393835.692813:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807183744 00000100:00100000:1.0:1785393835.692909:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1785393835.692922:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd042050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:9673:x1872120807183744:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:1.0:1785393835.693259:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd042050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:9673:x1872120807183744:12345-192.168.203.12@tcp:35:rm.0 Request processed in 339us (4213us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785393835.693267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1785393835.700790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.701026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807184000 00000100:00100000:3.0:1785393835.701038:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807184000 00000100:00100000:3.0:1785393835.701113:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1785393835.701125:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:9673:x1872120807184000:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1785393835.701157:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.701183:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5d6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.701336:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629ba2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.701352:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.701366:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393835.701381:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1785393835.701621:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5d6 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.701699:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5d6 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.701722:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:3.0:1785393835.701726:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785393835.701730:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1600, rc 0) 00000100:00100000:3.0:1785393835.701924:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184000:12345-192.168.203.12@tcp:101:rm.0 Request processed in 733us (1079us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1785393835.701932:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1785393835.728616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.728736:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807184128 00000100:00100000:0.0:1785393835.728748:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807184128 00000100:00100000:0.0:1785393835.728825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1785393835.728837:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184128:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:0.0:1785393835.728925:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1785393835.729024:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184128:12345-192.168.203.12@tcp:41:rm.0 Request processed in 189us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393835.729032:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1785393835.736872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393835.738384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807184256 00000100:00100000:3.0:1785393835.738399:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807184256 00000100:00100000:3.0:1785393835.738471:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1785393835.738483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184256:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1785393835.738508:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393835.738543:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629bb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738652:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738683:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738699:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738707:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.738736:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739084:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739092:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739099:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393835.739133:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1785393835.739138:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393835.739159:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739172:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739181:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739186:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739193:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739200:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393835.739204:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739217:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739228:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:3.0:1785393835.739231:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393835.739236:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739242:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b3629bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739268:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739275:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739280:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739285:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393835.739287:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739293:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739299:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff93acd8302600) 00010000:00010000:3.0:1785393835.739302:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393835.739304:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739319:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739354:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629bb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739367:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5dd expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393835.739375:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acd8302800) 00010000:00010000:3.0:1785393835.739377:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393835.739380:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0000, rc 0) 00000100:00100000:3.0:1785393835.739465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:9673:x1872120807184256:12345-192.168.203.12@tcp:101:rm.0 Request processed in 984us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393835.739474:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1785393835.749500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393835.749734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807184512 00000100:00100000:0.0:1785393835.749748:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807184512 00000100:00100000:0.0:1785393835.749824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1785393835.749835:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:9673:x1872120807184512:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1785393835.749914:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1785393835.749948:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5dd expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.749972:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c1 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.749984:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393835.750001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5c8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750010:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:0.0:1785393835.750014:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393835.750039:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750055:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750065:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750101:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750109:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750117:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750256:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750265:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.750272:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785393835.751173:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1785393835.751186:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367782614941ns, next at 368782612158ns, rc = 0 00010000:00010000:0.0:1785393835.751249:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751262:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751271:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751280:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751297:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751303:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751324:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785393835.751349:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751355:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751361:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751368:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.751373:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751382:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751392:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:0.0:1785393835.751395:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785393835.751400:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751407:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629bda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751427:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751439:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751444:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751449:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.751453:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751459:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751468:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:0.0:1785393835.751470:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393835.751473:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.751478:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629bcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393835.751494:0:5832:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cecbe2b reply state 000000002a8db49b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393835.751502:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393835.751644:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184512:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1807us (2154us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1785393835.751653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00010000:00010000:2.0:1785393835.752173:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393835.752181:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.752189:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393835.752192:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.752199:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.752210:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:2.0:1785393835.752213:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785393835.752216:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.752222:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629be1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393835.752240:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393835.752243:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393835.752245:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393835.756776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1785393835.757010:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757026:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757035:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757043:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.757050:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757060:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757081:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8d93c3d9 (ffff93acc7d14b00) 00010000:00010000:1.0:1785393835.757084:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.757090:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.757097:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629bd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8d93c3d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393835.758292:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807184768 00000100:00100000:0.0:1785393835.758307:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807184768 00000100:00100000:0.0:1785393835.758431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1785393835.758444:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:9673:x1872120807184768:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:0.0:1785393835.758840:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807184768:12345-192.168.203.12@tcp:35:rm.0 Request processed in 397us (2085us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1785393835.758849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1785393835.767318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393835.767473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185024 00000100:00100000:1.0:1785393835.767486:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185024 00000100:00100000:1.0:1785393835.767770:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1785393835.767786:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:9673:x1872120807185024:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1785393835.767870:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785393835.767904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5d6 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.767968:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5b3 expref: 15 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.767983:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:1.0:1785393835.768002:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5a5 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:1.0:1785393835.768018:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393835.768045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768058:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768069:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768081:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768087:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768092:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768445:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768464:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.768473:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393835.775391:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1785393835.775425:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775437:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775447:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775454:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.775460:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775469:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775488:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93acc3c44500) 00010000:00010000:1.0:1785393835.775491:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785393835.775496:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.775504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b3629bf6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776807:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776830:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776837:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776843:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393835.776846:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776909:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776922:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc3c44e00) 00010000:00010000:1.0:1785393835.776925:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393835.776929:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393835.776934:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b3629be8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393835.776951:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001589c02d reply state 00000000202197af transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393835.776960:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393835.777091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:9673:x1872120807185024:12345-192.168.203.12@tcp:36:rm.0 Request processed in 9304us (9782us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785393835.787047:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:0.0:1785393835.794133:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794155:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794163:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794170:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393835.794176:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794184:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794204:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93acc3c44200) 00010000:00010000:0.0:1785393835.794207:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393835.794212:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393835.794218:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629bef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393836.128051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393836.237737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393836.237789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393836.237817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393836.237945:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185408 00000100:00100000:0.0:1785393836.237973:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185408 00000100:00100000:0.0:1785393836.238033:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1785393836.238044:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393836.238129:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 88us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393836.238137:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1785393836.239156:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185280 00000100:00100000:1.0:1785393836.239164:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185280 00000100:00100000:1.0:1785393836.239217:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1785393836.239224:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807185280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393836.239278:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807185280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393836.239285:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1785393836.240096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393836.240333:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185152 00000100:00100000:3.0:1785393836.240339:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185152 00000100:00100000:3.0:1785393836.240377:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:3.0:1785393836.240385:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807185152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393836.240706:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807185152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 321us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393836.240714:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 264 00000100:00100000:0.0:1785393836.240928:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185536 00000100:00100000:0.0:1785393836.240933:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185536 00000100:00100000:0.0:1785393836.240985:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1785393836.240992:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807185536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393836.241022:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807185536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393836.241028:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00080000:3.0:1785393836.241508:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393837.152791:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393838.185766:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393839.207090:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393839.651706:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831342080:0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.651779:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393839.651835:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785393839.651841:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831341696:0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.653975:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393839.654025:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831342208:0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.654053:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393839.654092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341696 00000100:00100000:0.0:1785393839.654099:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341696 00000100:00100000:0.0:1785393839.654141:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1785393839.654150:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831341696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.654211:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831341696:12345-0@lo:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393839.654219:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1785393839.656097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342208 00000100:00100000:0.0:1785393839.656102:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342208 00000100:00100000:0.0:1785393839.656152:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785393839.656160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831342208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.656214:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831342208:12345-0@lo:400:kworker.0 Request processed in 55us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393839.656335:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342080 00000100:00100000:2.0:1785393839.656340:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342080 00000100:00100000:2.0:1785393839.656373:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785393839.656380:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831342080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393839.656417:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831342080:12345-0@lo:400:kworker.0 Request processed in 38us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393839.656424:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1785393839.656483:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393839.656488:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393839.656518:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785393839.656561:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831341696:0@lo:400:kworker.0 00000100:00100000:2.0:1785393839.656976:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831341824:0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.657027:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831342208:0@lo:400:kworker.0 00000100:00100000:3.0:1785393839.657100:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831341952:0@lo:400:kworker.0 00000100:00100000:2.0:1785393839.675770:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393839.675834:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831342336:0@lo:400:kworker.0 00000100:00100000:2.0:1785393839.675885:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393839.675944:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342336 00000100:00100000:1.0:1785393839.675959:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342336 00000100:00100000:1.0:1785393839.676071:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785393839.676084:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831342336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1785393839.676220:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1785393839.676296:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ab0380 x1872120831342080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393839.676311:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831342080:0@lo:400:kworker.0 00000100:00100000:0.0:1785393839.676361:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341824 00000100:00100000:0.0:1785393839.676366:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341824 00000100:00100000:0.0:1785393839.676416:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1785393839.676425:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831341824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393839.676594:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831342336:12345-0@lo:400:kworker.0 Request processed in 510us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393839.676603:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785393839.685476:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393839.686032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831341952 00000100:00100000:3.0:1785393839.686040:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831341952 00000100:00100000:3.0:1785393839.686093:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785393839.686102:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393839.686162:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831341952:12345-0@lo:400:kworker.0 Request processed in 61us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393839.686170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785393839.686214:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831341952:0@lo:400:kworker.0 00000100:00080000:2.0:1785393839.686446:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393839.688607:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831341824:12345-0@lo:400:kworker.0 Request processed in 12177us (12837us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393839.688617:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1785393839.696879:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831341824:0@lo:400:kworker.0 00010000:00080000:1.0:1785393839.696909:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7aca300 x1872120831342336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393839.696934:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831342336:0@lo:400:kworker.0 00000100:00100000:1.0:1785393840.170730:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393840.170869:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831342464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393840.170951:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393840.171027:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342464 00000100:00100000:1.0:1785393840.171034:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342464 00000100:00100000:1.0:1785393840.171079:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785393840.171089:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831342464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393840.171139:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393840.171184:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831342464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393840.171192:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1785393840.171251:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff9b6300 x1872120831342464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393840.171281:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831342464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393840.224769:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785393840.674209:0:6674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372705636331ns, next at 373705634129ns, rc = 0 00000100:00100000:2.0:1785393840.674244:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393840.674263:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831342592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393840.674353:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393840.674417:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342592 00000100:00100000:2.0:1785393840.674425:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342592 00000100:00100000:2.0:1785393840.674469:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785393840.674477:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831342592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785393840.674514:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393840.674556:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831342592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393840.674588:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1785393840.674627:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7ea6a00 x1872120831342592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393840.674645:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831342592:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1785393840.763041:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1785393840.763058:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1785393840.763087:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1785393840.763094:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1785393840.763487:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831342720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785393840.763553:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393840.763800:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342720 00000100:00100000:2.0:1785393840.763807:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342720 00000100:00100000:2.0:1785393840.763847:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785393840.763865:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831342720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785393840.763889:0:6630:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1785393840.763917:0:6630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a6af2aa, atime: 0x6a6af2aa, ctime: 0x6a6af2aa, blocks: 0x1 00010000:00010000:2.0:1785393840.763924:0:6630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.763937:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1785393840.763941:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393840.763948:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.763962:0:6630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.763972:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.763991:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.764007:0:6630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785393840.767356:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831342720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3486us (3796us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1785393840.767369:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1785393840.767396:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393840.767403:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.767414:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393840.767418:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.767428:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.767447:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.767455:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b9384c3/0xcc9b96d8b3629bfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393840.767472:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393840.767484:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393840.767486:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785393840.768308:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acc12a9500/2, rc 0, transno 4294967300 00000100:00100000:3.0:1785393840.768316:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831342720:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1785393841.251649:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393841.351739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393841.351780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393841.351809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393841.351842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393841.351979:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185792 00000100:00100000:0.0:1785393841.351989:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185792 00000100:00100000:0.0:1785393841.352048:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186048 00000100:00100000:0.0:1785393841.352052:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186048 00000100:00100000:0.0:1785393841.352078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1785393841.352087:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393841.352169:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393841.352177:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1785393841.352194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:0.0:1785393841.352212:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807186048:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393841.352236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807186048:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393841.352242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:3.0:1785393841.352361:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185664 00000100:00100000:3.0:1785393841.352366:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185664 00000100:00100000:3.0:1785393841.352403:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:3.0:1785393841.352409:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807185664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393841.352437:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807185664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393841.352443:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 266 00000100:00100000:1.0:1785393841.352531:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807185920 00000100:00100000:1.0:1785393841.352536:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807185920 00000100:00100000:1.0:1785393841.352617:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1785393841.352634:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185920:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393841.352660:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807185920:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393841.352666:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00080000:2.0:1785393841.353658:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393841.353664:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393842.271952:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393843.311038:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785393843.618284:0:11508:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1785393844.319684:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393844.768994:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831342848:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769089:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393844.769135:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831343104:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769163:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831343360:0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.769178:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393844.769198:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393844.769223:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785393844.769227:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393844.769231:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831342976:0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.769238:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831343232:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769257:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393844.769276:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393844.769279:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831343488:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769310:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393844.769316:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831343104 00000100:00100000:0.0:1785393844.769325:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831343104 00000100:00100000:1.0:1785393844.769365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342848 00000100:00100000:1.0:1785393844.769371:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342848 00000100:00100000:0.0:1785393844.769383:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831343360 00000100:00100000:0.0:1785393844.769393:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831343360 00000100:00100000:1.0:1785393844.769411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1785393844.769416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831342976 00000100:00100000:0.0:1785393844.769420:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831342976 00000100:00100000:1.0:1785393844.769425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831342848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.769436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1785393844.769444:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831343104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769487:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831342848:12345-0@lo:400:kworker.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393844.769495:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1785393844.769500:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831343104:12345-0@lo:400:kworker.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393844.769509:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1785393844.769528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1785393844.769535:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831343360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.769542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785393844.769552:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831342976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.769563:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831343360:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393844.769593:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1785393844.769611:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831343232 00000100:00100000:0.0:1785393844.769614:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831343232 00000100:00080000:2.0:1785393844.769902:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393844.769907:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393844.770080:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831343488 00000100:00100000:0.0:1785393844.770085:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831343488 00000100:00100000:0.0:1785393844.770115:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785393844.770122:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831343232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.770155:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831343232:12345-0@lo:400:kworker.0 Request processed in 33us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393844.770161:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785393844.770171:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785393844.770176:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831343488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.770197:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831343488:12345-0@lo:400:kworker.0 Request processed in 21us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393844.770202:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785393844.770347:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831343232:0@lo:400:kworker.0 00000100:00100000:0.0:1785393844.770357:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831343104:0@lo:400:kworker.0 00000100:00080000:2.0:1785393844.772387:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785393844.772819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831342976:12345-0@lo:400:kworker.0 Request processed in 3221us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393844.772832:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785393844.772955:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831342976:0@lo:400:kworker.0 00010000:00080000:1.0:1785393844.772973:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7eb9500 x1872120831343488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393844.772985:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831343488:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.772995:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831343360:0@lo:400:kworker.0 00000100:00100000:1.0:1785393844.773005:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831342848:0@lo:400:kworker.0 00000100:00100000:3.0:1785393845.280349:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393845.280376:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831343616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393845.280464:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393845.280551:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831343616 00000100:00100000:3.0:1785393845.280561:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831343616 00000100:00100000:3.0:1785393845.280634:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1785393845.280662:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831343616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393845.280722:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393845.280776:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831343616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.280785:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1785393845.280835:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8f8e00 x1872120831343616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393845.280856:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831343616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393845.356874:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785393845.441523:0:11556:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffeb29570 20000000:00000080:0.0:1785393845.441544:0:11556:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acff9f9400 uarg=0000000000000000 20000000:01000000:0.0:1785393845.445841:0:11556:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1785393845.445851:0:11556:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1785393845.445857:0:11556:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1785393845.462231:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1785393845.473991:0:11556:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1785393845.495479:0:11556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1785393845.496471:0:11556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1785393845.496561:0:11556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1785393845.496823:0:11556:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785393845.496843:0:11556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496862:0:11556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496871:0:11556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496878:0:11556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496886:0:11556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496893:0:11556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496914:0:11556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496951:0:11556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.496966:0:11556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 12 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.497929:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831343744:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393845.498475:0:11556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.498487:0:11556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.498497:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831343872:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393845.498542:0:11556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.498551:0:11556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 18 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.498560:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344000:0@lo:104: 00000100:00100000:1.0:1785393845.503485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393845.503556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393845.503623:0:11556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785393845.503690:0:11556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.503728:0:11556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 18 pid: 5825 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.503742:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344128:0@lo:104: 00000100:00100000:2.0:1785393845.503783:0:11556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393845.503809:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344000 00000100:00100000:2.0:1785393845.503815:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344000 00000100:00100000:2.0:1785393845.503846:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344128 00000100:00100000:2.0:1785393845.503848:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344128 00000100:00100000:2.0:1785393845.503864:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785393845.503871:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:11556:x1872120831344000:12345-0@lo:104: 00010000:00010000:2.0:1785393845.503883:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.503939:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785393845.503945:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+4:11556:x1872120831344000:12345-0@lo:104: Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393845.503952:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785393845.503968:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785393845.503974:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11556:x1872120831344128:12345-0@lo:104: 00010000:00010000:2.0:1785393845.503993:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.504025:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785393845.504030:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11556:x1872120831344128:12345-0@lo:104: Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393845.504036:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1785393845.504073:0:11556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.504081:0:11556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.504090:0:11556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344256:0@lo:104: 00000100:00100000:2.0:1785393845.504114:0:11556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393845.504149:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785393845.504158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344256 00000100:00100000:2.0:1785393845.504161:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344256 00000100:00100000:2.0:1785393845.504177:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393845.504184:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acffaf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11556:x1872120831344256:12345-0@lo:104: 00010000:00010000:2.0:1785393845.504192:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393845.504220:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785393845.504224:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acffaf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+3:11556:x1872120831344256:12345-0@lo:104: Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393845.504230:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785393845.504265:0:11556:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57300 going to sleep for 11 seconds 00000100:00100000:2.0:1785393845.504286:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831343744:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393845.504308:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831343872:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393845.504316:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344000:0@lo:104: 00000100:00100000:2.0:1785393845.504322:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344128:0@lo:104: 00000100:00100000:2.0:1785393845.504328:0:11556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11556:1872120831344256:0@lo:104: 00010000:00010000:2.0:1785393845.504352:0:11556:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506148:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785393845.506165:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506178:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393845.506183:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506195:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393845.506204:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393845.506210:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785393845.506277:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506284:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393845.506331:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506339:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0045600/0xcc9b96d8b3629abb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ac2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506359:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785393845.506364:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506371:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393845.506374:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506382:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393845.506389:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393845.506404:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785393845.506418:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506424:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393845.506439:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506446:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0045200/0xcc9b96d8b3629aad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629ab4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506454:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393845.506464:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506471:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044c00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393845.506474:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506482:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393845.506488:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393845.506494:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785393845.506519:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506525:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393845.506532:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506538:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0044c00/0xcc9b96d8b3629a9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b3629aa6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.506555:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393845.506557:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393845.506559:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393845.506597:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831344384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785393845.506695:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831344512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785393845.506740:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393845.508783:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831344640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393845.511250:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393845.512678:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393845.527744:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393845.527786:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186176 00000100:00100000:3.0:1785393845.527796:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186176 00010000:00010000:3.0:1785393845.527845:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 13 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393845.527873:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186304 00000100:00100000:3.0:1785393845.527876:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186304 00010000:00010000:3.0:1785393845.527887:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 14 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393845.527897:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344512 00000100:00100000:3.0:1785393845.527900:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344512 00010000:00010000:3.0:1785393845.527912:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 19 pid: 5825 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393845.527922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344640 00000100:00100000:3.0:1785393845.527925:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344640 00010000:00010000:3.0:1785393845.527947:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 20 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393845.527962:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1785393845.527972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+14:2358:x1872120807186176:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.527989:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393845.527995:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 14 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528008:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 14 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528029:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b3629ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd597 expref: 14 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528064:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393845.528132:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807186176:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 160us (24654us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.528140:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1785393845.528158:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1785393845.528164:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:2358:x1872120807186304:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.528172:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393845.528177:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528187:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528198:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd590 expref: 12 pid: 5824 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528207:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393845.528224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2358:x1872120807186304:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 61us (24669us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.528231:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1785393845.528243:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785393845.528249:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+20:3317:x1872120831344512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.528257:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393845.528261:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 20 pid: 5825 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528280:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 20 pid: 5825 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528291:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629ab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629aad expref: 20 pid: 5825 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528300:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393845.528349:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3317:x1872120831344512:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (21609us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.528355:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785393845.528368:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785393845.528374:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3318:x1872120831344640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.528381:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393845.528386:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528394:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528416:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0200/0xcc9b96d8b3629aa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629a9f expref: 18 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528426:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393845.528452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:3318:x1872120831344640:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.528458:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785393845.528640:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831344640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785393845.528668:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393845.528717:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344384 00000100:00100000:3.0:1785393845.528722:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344384 00010000:00010000:3.0:1785393845.528736:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 17 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393845.528750:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785393845.528755:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd8efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:3316:x1872120831344384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.528762:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393845.528766:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 17 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528774:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 17 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528784:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f0800/0xcc9b96d8b3629ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b3629abb expref: 17 pid: 5824 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528796:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528806:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528823:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528831:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528838:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528854:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528861:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393845.528865:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528875:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528893:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.528904:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393845.528935:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd8efd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3316:x1872120831344384:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393845.528941:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785393845.529001:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831344384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785393845.529023:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3317:1872120831344512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393845.529066:0:11556:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.529075:0:11556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393845.529083:0:11556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1800/0xcc9b96d8b3629c04 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393845.795741:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831344768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393845.795832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393845.797504:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344768 00000100:00100000:1.0:1785393845.797517:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344768 00000100:00100000:1.0:1785393845.797614:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785393845.797627:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831344768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393845.797704:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393845.797779:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831344768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393845.797787:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785393845.798133:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831344768:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1785393845.938996:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1785393846.368374:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393846.473077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393846.473124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393846.473172:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393846.473231:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393846.473391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186560 00000100:00100000:0.0:1785393846.473404:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186560 00000100:00100000:3.0:1785393846.473423:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186432 00000100:00100000:3.0:1785393846.473428:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186432 00000100:00100000:0.0:1785393846.473472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186816 00000100:00100000:0.0:1785393846.473476:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186816 00000100:00100000:3.0:1785393846.473488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:0.0:1785393846.473498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:3.0:1785393846.473500:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2360:x1872120807186432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393846.473504:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807186560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393846.473608:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807186560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393846.473617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00080000:1.0:1785393846.473621:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393846.473635:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1785393846.473641:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807186816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393846.476361:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2360:x1872120807186432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2852us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393846.476375:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 268 00000100:00100000:3.0:1785393846.476489:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186688 00000100:00100000:3.0:1785393846.476497:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186688 00000100:00100000:3.0:1785393846.476559:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:3.0:1785393846.476582:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807186688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393846.476619:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807186688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 53us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393846.476624:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00080000:2.0:1785393846.477035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393846.483683:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807186816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 10024us (10540us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393846.483709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:3.0:1785393847.177608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393847.177722:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807186944 00000100:00100000:0.0:1785393847.177735:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807186944 00000100:00100000:0.0:1785393847.177804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 269 00000100:00100000:0.0:1785393847.177815:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:5582:x1872120807186944:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393847.177853:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393847.177888:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace0044e00/0xcc9b96d8b3629c0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5e4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.177924:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace0044e00/0xcc9b96d8b3629c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5e4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.177937:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace0044e00/0xcc9b96d8b3629c0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5e4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.177947:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044e00, rc 0) 00000100:00100000:0.0:1785393847.178016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807186944:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 202us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.178024:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 269 00000100:00100000:1.0:1785393847.197546:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393847.197746:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187072 00000100:00100000:3.0:1785393847.197758:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187072 00000100:00100000:3.0:1785393847.197824:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:3.0:1785393847.197836:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807187072:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.198187:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807187072:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 352us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393847.198195:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:1.0:1785393847.220386:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393847.220529:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187200 00000100:00100000:3.0:1785393847.220558:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187200 00000100:00100000:3.0:1785393847.220665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:3.0:1785393847.220677:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807187200:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.221141:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807187200:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 466us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393847.221856:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:1.0:1785393847.228864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393847.229053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187328 00000100:00100000:0.0:1785393847.229065:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187328 00000100:00100000:0.0:1785393847.229139:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:0.0:1785393847.229161:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:9944:x1872120807187328:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785393847.229482:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:9944:x1872120807187328:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 332us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.229491:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:0.0:1785393847.253365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393847.253495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187456 00000100:00100000:1.0:1785393847.253508:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187456 00000100:00100000:1.0:1785393847.253602:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:1.0:1785393847.253615:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:9944:x1872120807187456:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785393847.253947:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:9944:x1872120807187456:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 334us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.253956:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:1.0:1785393847.270889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393847.271168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187584 00000100:00100000:3.0:1785393847.271181:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187584 00000100:00100000:3.0:1785393847.271258:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:3.0:1785393847.271270:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:5582:x1872120807187584:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393847.271292:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393847.271315:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629c12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5eb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.271348:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5eb expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.271361:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5eb expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.271372:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1200, rc 0) 00000100:00100000:3.0:1785393847.284628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807187584:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 13343us (13744us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393847.284645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:3.0:1785393847.291747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393847.292236:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187712 00000100:00100000:0.0:1785393847.292248:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187712 00000100:00100000:0.0:1785393847.292315:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:0.0:1785393847.292328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807187712:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.292723:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807187712:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 396us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.292732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:0.0:1785393847.304241:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393847.304623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187840 00000100:00100000:3.0:1785393847.304635:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187840 00000100:00100000:3.0:1785393847.304735:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:3.0:1785393847.304746:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807187840:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785393847.306785:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:5582:x1872120807187840:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 2034us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393847.306796:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 276 00000100:00100000:2.0:1785393847.319422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393847.322090:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807187968 00000100:00100000:0.0:1785393847.322106:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807187968 00000100:00100000:0.0:1785393847.322177:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:0.0:1785393847.322188:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:9947:x1872120807187968:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785393847.322502:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:9947:x1872120807187968:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 315us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.322511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:1.0:1785393847.342932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393847.343175:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188096 00000100:00100000:2.0:1785393847.343186:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188096 00000100:00100000:2.0:1785393847.343241:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 278 00000100:00100000:2.0:1785393847.343251:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:9947:x1872120807188096:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785393847.343555:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:9947:x1872120807188096:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 303us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393847.343593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 278 00010000:00010000:2.0:1785393847.392456:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785393847.456044:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785393847.456053:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc8926000 from 7 10000000:01000000:2.0:1785393847.456059:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785393847.456120:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393847.456164:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393847.456179:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393847.456210:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831344896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785393847.456289:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393847.456353:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd08c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.458256:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831344896 00000100:00100000:1.0:1785393847.458266:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831344896 00000100:00100000:1.0:1785393847.458332:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1785393847.458343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:5828:x1872120831344896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393847.458362:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393847.458400:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629c20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629c19 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.458429:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c19 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.458441:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c19 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.458451:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42000, rc 0) 00000100:00100000:1.0:1785393847.458816:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831344896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 473us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.458825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1785393847.458903:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831344896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393847.458932:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.458943:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393847.459011:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.459041:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393847.459086:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785393847.459222:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345024 00000100:00100000:0.0:1785393847.459227:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345024 00000100:00100000:0.0:1785393847.459260:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1785393847.459268:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831345024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.460230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831345024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 960us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.460239:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1785393847.472929:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.473021:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.473121:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393847.473391:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345152 00000100:00100000:2.0:1785393847.473399:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345152 00000100:00100000:2.0:1785393847.473455:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1785393847.473465:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831345152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.474262:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393847.474339:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831345152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 874us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393847.474347:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1785393847.476694:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.487901:0:11571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11571:1872120831345280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393847.488021:0:11571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393847.488093:0:11571:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.488288:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345280 00000100:00100000:1.0:1785393847.488297:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345280 00000100:00100000:1.0:1785393847.488350:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1785393847.488358:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:11571:x1872120831345280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393847.488895:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:11571:x1872120831345280:12345-0@lo:502:llog_process_th.0 Request processed in 536us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.488904:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1785393847.489121:0:11571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11571:1872120831345280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785393847.489152:0:11571:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785393847.489162:0:11571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393847.489165:0:11571:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785393847.489177:0:11571:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93acc8926000 00000020:00000080:3.0:1785393847.489180:0:11571:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785393847.489254:0:11571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11571:1872120831345408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785393847.489283:0:11571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393847.489320:0:11571:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.494832:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345408 00000100:00100000:1.0:1785393847.494848:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345408 00000100:00100000:1.0:1785393847.494927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1785393847.494939:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:11571:x1872120831345408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393847.495270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:11571:x1872120831345408:12345-0@lo:502:llog_process_th.0 Request processed in 331us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.495277:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1785393847.496776:0:11571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11571:1872120831345408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785393847.496824:0:11571:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785393847.496836:0:11571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785393847.496838:0:11571:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785393847.496845:0:11571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785393847.497017:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1785393847.497035:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785393847.497045:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.497057:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393847.497068:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785393847.497070:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc825e800 from 7 10000000:01000000:3.0:1785393847.497073:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785393847.497110:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.497118:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.497128:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393847.497175:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.497228:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393847.497276:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.500068:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345536 00000100:00100000:1.0:1785393847.500097:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345536 00000100:00100000:1.0:1785393847.500172:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1785393847.500183:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:5828:x1872120831345536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393847.500201:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393847.500218:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629c2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629c27 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.500248:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c27 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.500261:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c27 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.500271:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43800, rc 0) 00000100:00100000:1.0:1785393847.500348:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831345536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.500355:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1785393847.500743:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785393847.500763:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393847.500774:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393847.500854:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.500891:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393847.500935:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.501046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345664 00000100:00100000:1.0:1785393847.501050:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345664 00000100:00100000:1.0:1785393847.501079:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1785393847.501086:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831345664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785393847.501359:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831345664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.501367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1785393847.501524:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.501560:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.501631:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.501652:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785393847.501664:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345792 00000100:00100000:0.0:1785393847.501668:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345792 00000100:00100000:0.0:1785393847.501704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1785393847.501719:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831345792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.501873:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831345792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.501880:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1785393847.501919:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831345792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.502141:0:11573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11573:1872120831345920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393847.502176:0:11573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.502194:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831345920 00000100:00100000:0.0:1785393847.502197:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831345920 00000100:00100000:0.0:1785393847.502212:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1785393847.502217:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:11573:x1872120831345920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393847.502335:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:11573:x1872120831345920:12345-0@lo:502:llog_process_th.0 Request processed in 116us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.502342:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1785393847.502369:0:11573:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393847.502561:0:11573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11573:1872120831345920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393847.502605:0:11573:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785393847.502616:0:11573:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393847.502618:0:11573:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785393847.502625:0:11573:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93acc825e800 00000020:00000080:0.0:1785393847.502628:0:11573:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785393847.502828:0:11573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11573:1872120831346048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393847.502858:0:11573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.502876:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346048 00000100:00100000:0.0:1785393847.502879:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346048 00000100:00100000:0.0:1785393847.502897:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1785393847.502902:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:11573:x1872120831346048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393847.502994:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc823f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:11573:x1872120831346048:12345-0@lo:502:llog_process_th.0 Request processed in 91us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.503000:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1785393847.503023:0:11573:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2f62480 going to sleep for 11 seconds 00000100:00100000:0.0:1785393847.503032:0:11573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11573:1872120831346048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785393847.503047:0:11573:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785393847.503050:0:11573:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785393847.503052:0:11573:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785393847.503055:0:11573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1785393847.503100:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1785393847.503117:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393847.503125:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.503134:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393847.505827:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785393847.505834:0:5828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ace0136800 from 7 10000000:01000000:0.0:1785393847.505839:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785393847.505885:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.505897:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.505910:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393847.505942:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.506004:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.506039:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.506222:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346176 00000100:00100000:1.0:1785393847.506231:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346176 00000100:00100000:1.0:1785393847.506276:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1785393847.506285:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:5828:x1872120831346176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785393847.506306:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393847.506320:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629c3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b3629c35 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.506345:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c35 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.506356:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b3629c35 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393847.506365:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42e00, rc 0) 00000100:00100000:1.0:1785393847.506427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831346176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.506435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1785393847.507841:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785393847.507861:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.507872:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393847.507936:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.507982:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.508019:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393847.508223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346304 00000100:00100000:3.0:1785393847.508229:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346304 00000100:00100000:3.0:1785393847.508268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1785393847.508277:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831346304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.508796:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831346304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 519us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393847.508804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1785393847.511003:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.511060:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785393847.511128:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393847.511715:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393847.527839:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346432 00000100:00100000:3.0:1785393847.527862:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346432 00000100:00100000:3.0:1785393847.527948:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1785393847.527958:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831346432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785393847.529652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:5828:x1872120831346432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1693us (18521us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393847.529672:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1785393847.542906:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:5828:1872120831346432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785393847.544129:0:11575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11575:1872120831346560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393847.544228:0:11575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393847.544285:0:11575:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1785393847.544340:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346560 00000100:00100000:0.0:1785393847.544348:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346560 00000100:00100000:0.0:1785393847.544416:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1785393847.544427:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:11575:x1872120831346560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785393847.544720:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:11575:x1872120831346560:12345-0@lo:502:llog_process_th.0 Request processed in 294us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393847.544737:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1785393847.545067:0:11575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11575:1872120831346560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785393847.545090:0:11575:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785393847.545100:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393847.545103:0:11575:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785393847.545109:0:11575:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ace0136800 00000020:00000080:1.0:1785393847.545112:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785393847.545214:0:11575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11575:1872120831346688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393847.545246:0:11575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393847.545266:0:11575:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1785393847.546628:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346688 00000100:00100000:1.0:1785393847.546642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346688 00000100:00100000:1.0:1785393847.546668:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1785393847.546675:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:11575:x1872120831346688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785393847.546840:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:11575:x1872120831346688:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393847.546847:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1785393847.546888:0:11575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:11575:1872120831346688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785393847.546909:0:11575:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785393847.546915:0:11575:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785393847.546917:0:11575:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785393847.546921:0:11575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1785393847.547835:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1785393847.547857:0:5828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785393847.547870:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393847.547882:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785393847.587679:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785393848.419118:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393848.608908:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785393849.452833:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393849.891402:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831347200:0@lo:400:kworker.0 00000100:00100000:1.0:1785393849.891497:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393849.891619:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785393849.891627:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831346816:0@lo:400:kworker.0 00000100:00100000:1.0:1785393849.891662:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393849.891703:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831347328:0@lo:400:kworker.0 00000100:00100000:1.0:1785393849.891732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393849.891904:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346816 00000100:00100000:3.0:1785393849.892011:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831346944:0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892045:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393849.892081:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831347456:0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892106:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393849.892129:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393849.892135:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831347072:0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892157:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393849.892204:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347328 00000100:00100000:3.0:1785393849.892210:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347328 00000100:00100000:3.0:1785393849.892267:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831346944 00000100:00100000:3.0:1785393849.892270:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346944 00000100:00100000:3.0:1785393849.892284:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347072 00000100:00100000:3.0:1785393849.892286:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347072 00000100:00100000:3.0:1785393849.892306:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1785393849.892316:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831347328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892381:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831347328:12345-0@lo:400:kworker.0 Request processed in 65us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393849.892388:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1785393849.892408:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1785393849.892414:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831346944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892450:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831346944:12345-0@lo:400:kworker.0 Request processed in 36us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393849.892478:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1785393849.892492:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785393849.892509:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831347072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.892543:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831347072:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393849.892549:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785393849.892588:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347200 00000100:00100000:3.0:1785393849.892592:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347200 00000100:00100000:3.0:1785393849.892620:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347456 00000100:00100000:3.0:1785393849.892623:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347456 00000100:00100000:3.0:1785393849.892643:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785393849.892650:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393849.894019:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831346816 00000100:00100000:1.0:1785393849.894075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1785393849.894084:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831346816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393849.894171:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393849.894183:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831347456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393849.894513:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831347328:0@lo:400:kworker.0 00000100:00100000:0.0:1785393849.894621:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831347072:0@lo:400:kworker.0 00000100:00100000:0.0:1785393849.894635:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831346944:0@lo:400:kworker.0 00000100:00080000:0.0:1785393849.894663:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393849.894768:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393849.894773:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393849.901134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831346816:12345-0@lo:400:kworker.0 Request processed in 7035us (9454us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393849.901154:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1785393849.905416:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831347456:12345-0@lo:400:kworker.0 Request processed in 11222us (13294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393849.905434:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1785393849.905714:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc12a8000 x1872120831347456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393849.905733:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831347456:0@lo:400:kworker.0 00000100:00100000:0.0:1785393849.908705:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831346816:0@lo:400:kworker.0 00000100:00100000:3.0:1785393849.909683:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831347200:12345-0@lo:400:kworker.0 Request processed in 17019us (18173us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393849.909697:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785393849.909881:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1785393849.909888:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acc12a9500, transno 4294967300 00000100:00100000:0.0:1785393849.912063:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831347200:0@lo:400:kworker.0 00000100:00100000:0.0:1785393850.400090:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831347584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393850.400187:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393850.401126:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347584 00000100:00100000:3.0:1785393850.401138:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347584 00000100:00100000:3.0:1785393850.401203:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785393850.401213:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831347584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393850.401258:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393850.401327:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831347584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393850.401335:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1785393850.401651:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8fb100 x1872120831347584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393850.401681:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831347584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393850.464238:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393850.912503:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831347712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393850.912614:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393850.913293:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347712 00000100:00100000:1.0:1785393850.913304:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347712 00000100:00100000:1.0:1785393850.913368:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785393850.913379:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831347712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393850.913423:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393850.913543:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831347712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393850.913552:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785393850.914133:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831347712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393851.494697:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393851.589172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393851.589227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393851.589258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393851.589277:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393851.589331:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188352 00000100:00100000:2.0:1785393851.589342:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188352 00000100:00100000:2.0:1785393851.589400:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188608 00000100:00100000:2.0:1785393851.589402:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188608 00000100:00100000:2.0:1785393851.589435:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:2.0:1785393851.589446:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807188352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393851.589787:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807188352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 342us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393851.589796:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:2.0:1785393851.589816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:2.0:1785393851.589824:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807188608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393851.589851:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807188608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393851.589857:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:1.0:1785393851.590136:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188480 00000100:00100000:1.0:1785393851.590142:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188480 00000100:00100000:1.0:1785393851.590194:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1785393851.590203:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807188480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393851.590232:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807188480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393851.590239:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:0.0:1785393851.592056:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188224 00000100:00100000:0.0:1785393851.592066:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188224 00000100:00100000:0.0:1785393851.592117:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:0.0:1785393851.592127:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807188224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393851.592189:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807188224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393851.592196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00080000:0.0:1785393851.592232:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393851.592237:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785393852.514231:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393853.535798:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393854.560421:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393855.008099:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831347840:0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.008199:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393855.008309:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831348352:0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.008341:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393855.008373:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393855.008379:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831348224:0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.008405:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393855.008497:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831347968:0@lo:400:kworker.0 00000100:00100000:1.0:1785393855.008531:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393855.008560:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831348480:0@lo:400:kworker.0 00000100:00100000:1.0:1785393855.008607:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393855.008625:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393855.008630:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831348096:0@lo:400:kworker.0 00000100:00100000:1.0:1785393855.008701:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393855.008921:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348224 00000100:00100000:3.0:1785393855.008931:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348224 00000100:00100000:3.0:1785393855.009001:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348480 00000100:00100000:3.0:1785393855.009004:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348480 00000100:00100000:3.0:1785393855.009031:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1785393855.009040:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831348224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009103:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831348224:12345-0@lo:400:kworker.0 Request processed in 63us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393855.009111:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1785393855.009130:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1785393855.009135:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831348480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009170:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831348480:12345-0@lo:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393855.009176:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1785393855.009199:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348352 00000100:00100000:3.0:1785393855.009202:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348352 00000100:00100000:3.0:1785393855.009226:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347968 00000100:00100000:3.0:1785393855.009229:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347968 00000100:00100000:3.0:1785393855.009240:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348096 00000100:00100000:3.0:1785393855.009243:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348096 00000100:00100000:3.0:1785393855.009257:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785393855.009262:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831348352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009294:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831348352:12345-0@lo:400:kworker.0 Request processed in 32us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393855.009307:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785393855.009319:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1785393855.009324:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831347968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009354:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831347968:12345-0@lo:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393855.009360:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1785393855.009369:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1785393855.009375:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831348096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009401:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831348096:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393855.009407:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1785393855.009453:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831348224:0@lo:400:kworker.0 00000100:00100000:3.0:1785393855.009599:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831348352:0@lo:400:kworker.0 00000100:00100000:2.0:1785393855.009697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831347840 00000100:00100000:2.0:1785393855.009702:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831347840 00000100:00100000:2.0:1785393855.009742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1785393855.009751:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831347840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393855.009807:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831347840:12345-0@lo:400:kworker.0 Request processed in 58us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393855.009814:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1785393855.009861:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831347840:0@lo:400:kworker.0 00000100:00080000:1.0:1785393855.010098:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393855.010105:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393855.010108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393855.010130:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831348096:0@lo:400:kworker.0 00000100:00100000:1.0:1785393855.010143:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831347968:0@lo:400:kworker.0 00010000:00080000:1.0:1785393855.010159:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc12a8000 x1872120831348480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393855.010171:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831348480:0@lo:400:kworker.0 00000100:00100000:1.0:1785393855.523802:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393855.523831:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393855.523937:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393855.524171:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348608 00000100:00100000:2.0:1785393855.524182:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348608 00000100:00100000:2.0:1785393855.524247:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785393855.524277:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831348608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393855.524323:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393855.524398:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831348608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393855.524406:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1785393855.524558:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8f9880 x1872120831348608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393855.524616:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831348608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393855.584892:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393856.034957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393856.034985:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831348736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393856.035068:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393856.035695:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348736 00000100:00100000:0.0:1785393856.035714:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348736 00000100:00100000:0.0:1785393856.035912:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785393856.035924:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831348736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393856.035965:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393856.036031:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831348736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393856.036039:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785393856.036121:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831348736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393856.610030:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393856.712974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393856.713021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393856.713202:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188864 00000100:00100000:0.0:1785393856.713213:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188864 00000100:00100000:0.0:1785393856.713284:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1785393856.713296:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807188864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393856.713393:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807188864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393856.713401:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00080000:0.0:1785393856.713424:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393856.714058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188736 00000100:00100000:1.0:1785393856.714064:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188736 00000100:00100000:1.0:1785393856.714108:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:1.0:1785393856.714116:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807188736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393856.714154:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807188736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393856.714162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:0.0:1785393856.725430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393856.725538:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393856.725594:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807188992 00000100:00100000:0.0:1785393856.725620:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807188992 00000100:00100000:0.0:1785393856.725871:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1785393856.725883:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2357:x1872120807188992:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:0.0:1785393856.725920:0:6632:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629b78 00000100:00080000:0.0:1785393856.725929:0:6632:0:(import.c:65:import_set_state_nolock()) ffff93acc830d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785393856.725973:0:6632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1785393856.726331:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807188992:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 450us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393856.726339:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1785393856.726364:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189120 00000100:00100000:0.0:1785393856.726367:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189120 00000100:00100000:0.0:1785393856.726396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1785393856.726402:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807189120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393856.726431:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807189120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393856.726438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00080000:0.0:1785393856.726452:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393856.726456:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785393856.726467:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393857.632208:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393858.656836:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785393858.849983:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785393859.679832:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393860.132144:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831348864:0@lo:400:kworker.0 00000100:00100000:3.0:1785393860.132252:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393860.132799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348864 00000100:00100000:0.0:1785393860.132810:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348864 00000100:00100000:0.0:1785393860.132867:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1785393860.132878:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831348864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393860.135859:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831349248:0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.135963:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831349120:0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.136009:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393860.136046:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785393860.136053:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831348992:0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.136072:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393860.136087:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831349504:0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.136107:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393860.136304:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831348864:12345-0@lo:400:kworker.0 Request processed in 3426us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393860.136317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1785393860.136355:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349120 00000100:00100000:0.0:1785393860.136362:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349120 00000100:00100000:0.0:1785393860.136459:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831348992 00000100:00100000:0.0:1785393860.136463:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831348992 00000100:00100000:0.0:1785393860.136481:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1785393860.136488:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831349120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.136534:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831349120:12345-0@lo:400:kworker.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393860.136541:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1785393860.136553:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1785393860.136559:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831348992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.137186:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831348992:12345-0@lo:400:kworker.0 Request processed in 625us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393860.137194:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1785393860.137250:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831348992:0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.137262:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831349120:0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.137335:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349504 00000100:00100000:0.0:1785393860.137354:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349504 00000100:00080000:2.0:1785393860.137400:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393860.137406:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393860.137427:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393860.137463:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785393860.137471:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831349376:0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.137504:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349248 00000100:00100000:2.0:1785393860.137510:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349248 00000100:00100000:1.0:1785393860.137510:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393860.137546:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349376 00000100:00100000:1.0:1785393860.137551:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349376 00000100:00100000:2.0:1785393860.137559:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785393860.137593:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831349248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393860.137615:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1785393860.137625:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393860.137646:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831349248:12345-0@lo:400:kworker.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393860.137653:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785393860.137680:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831349376:12345-0@lo:400:kworker.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393860.137688:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1785393860.137719:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831349376:0@lo:400:kworker.0 00000100:00100000:1.0:1785393860.137730:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831349248:0@lo:400:kworker.0 00000100:00080000:2.0:1785393860.137812:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393860.137816:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393860.138145:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785393860.138152:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831349504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.138190:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831349504:12345-0@lo:400:kworker.0 Request processed in 39us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393860.138196:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1785393860.138224:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76bc000 x1872120831349504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393860.138236:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831349504:0@lo:400:kworker.0 00000100:00100000:3.0:1785393860.141110:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831348864:0@lo:400:kworker.0 00000100:00100000:0.0:1785393860.639918:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393860.639949:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831349632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393860.640039:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393860.640342:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349632 00000100:00100000:1.0:1785393860.640353:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349632 00000100:00100000:1.0:1785393860.640410:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785393860.640421:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831349632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393860.640465:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393860.640518:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831349632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393860.640526:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1785393860.640790:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8f9180 x1872120831349632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393860.640812:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831349632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393860.703854:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393861.153730:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831349760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393861.153838:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393861.153943:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349760 00000100:00100000:0.0:1785393861.153951:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349760 00000100:00100000:0.0:1785393861.154007:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785393861.154017:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831349760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393861.154059:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393861.154117:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831349760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393861.154125:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785393861.154386:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831349760:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1785393861.303705:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:2.0:1785393861.303725:0:6656:0:(genops.c:906:class_export_put()) final put ffff93acc830b800/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:1.0:1785393861.303958:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc830b800/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0000 00000020:00000080:1.0:1785393861.304024:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc830d800 for lustre-OST0000 00010000:00010000:1.0:1785393861.732648:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393861.829447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393861.829628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393861.829671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393861.830205:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189248 00000100:00100000:2.0:1785393861.830217:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189248 00000100:00100000:2.0:1785393861.830294:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:2.0:1785393861.830307:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807189248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393861.830394:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807189248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393861.830403:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:0.0:1785393861.847078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189376 00000100:00100000:0.0:1785393861.847096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189376 00000100:00100000:0.0:1785393861.847204:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189504 00000100:00100000:0.0:1785393861.847207:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189504 00000100:00100000:0.0:1785393861.847242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1785393861.847252:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807189376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393861.847368:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807189376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 118us (17936us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393861.847376:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1785393861.847392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:0.0:1785393861.847397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807189504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393861.847416:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807189504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (17745us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393861.847421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00080000:3.0:1785393861.847927:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393862.752721:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393863.775930:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393864.808327:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393865.247919:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831350144:0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248021:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393865.248101:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785393865.248108:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831350016:0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248133:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393865.248152:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831350528:0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248178:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393865.248218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350144 00000100:00100000:1.0:1785393865.248226:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350144 00000100:00100000:1.0:1785393865.248285:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350016 00000100:00100000:1.0:1785393865.248289:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350016 00000100:00100000:1.0:1785393865.248312:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785393865.248321:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831350144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248377:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831350144:12345-0@lo:400:kworker.0 Request processed in 57us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393865.248385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785393865.248405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785393865.248411:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831350016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248440:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831350016:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393865.248446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785393865.248497:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831350016:0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.248508:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831350144:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.248719:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831349888:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.248761:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393865.248807:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831350400:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.248830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393865.248847:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393865.248852:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831350272:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.248873:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1785393865.248897:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393865.249139:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831349888 00000100:00100000:1.0:1785393865.249144:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831349888 00000100:00100000:1.0:1785393865.249193:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1785393865.249200:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831349888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.249237:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831349888:12345-0@lo:400:kworker.0 Request processed in 37us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393865.249243:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1785393865.249271:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350528 00000100:00100000:1.0:1785393865.249274:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350528 00000100:00100000:1.0:1785393865.249304:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350272 00000100:00100000:1.0:1785393865.249307:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350272 00000100:00100000:1.0:1785393865.249326:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393865.249332:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831350528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.249366:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831350528:12345-0@lo:400:kworker.0 Request processed in 34us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393865.249373:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393865.249383:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785393865.249389:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831350272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1785393865.250127:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393865.250132:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393865.250158:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831349888:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.250182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350400 00000100:00100000:3.0:1785393865.250186:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350400 00000100:00100000:3.0:1785393865.250221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1785393865.250229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.250270:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831350400:12345-0@lo:400:kworker.0 Request processed in 42us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393865.250277:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1785393865.250293:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393865.250312:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831350400:0@lo:400:kworker.0 00010000:00080000:3.0:1785393865.250366:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf76bf100 x1872120831350528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393865.250387:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831350528:0@lo:400:kworker.0 00000100:00100000:1.0:1785393865.251128:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831350272:12345-0@lo:400:kworker.0 Request processed in 1738us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393865.251136:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1785393865.258520:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831350272:0@lo:400:kworker.0 00000100:00100000:3.0:1785393865.772317:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393865.772344:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831350656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393865.772423:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393865.772521:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350656 00000100:00100000:3.0:1785393865.772530:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350656 00000100:00100000:3.0:1785393865.772612:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785393865.772623:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831350656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393865.772669:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393865.772718:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831350656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393865.772726:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1785393865.772774:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acfb8f9180 x1872120831350656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393865.772810:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831350656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393865.827697:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393866.273280:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831350784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393866.273380:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393866.274898:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350784 00000100:00100000:3.0:1785393866.274910:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350784 00000100:00100000:3.0:1785393866.274964:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785393866.274974:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831350784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393866.275034:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393866.275900:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831350784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 924us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393866.275920:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785393866.275991:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831350784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393866.850176:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393866.950143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393866.950186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393866.950207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393866.950239:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189632 00000100:00100000:2.0:1785393866.950247:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189632 00000100:00100000:2.0:1785393866.950290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:2.0:1785393866.950299:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807189632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393866.950364:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807189632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393866.950371:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:3.0:1785393866.950480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189760 00000100:00100000:3.0:1785393866.950485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189760 00000100:00100000:3.0:1785393866.950532:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807189888 00000100:00100000:3.0:1785393866.950535:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807189888 00000100:00100000:3.0:1785393866.950567:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1785393866.950592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807189760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393866.950632:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807189760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393866.950638:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1785393866.950653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1785393866.950659:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807189888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393866.950681:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807189888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393866.950686:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00080000:2.0:1785393866.950821:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785393867.876720:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785393868.068214:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785393868.898979:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393869.920098:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393870.368341:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831351296:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368469:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785393870.368475:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831350912:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368502:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368523:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831351424:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368556:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368599:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831351040:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368620:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368650:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831351552:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368669:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368684:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393870.368689:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831351168:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368706:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393870.368730:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351296 00000100:00100000:0.0:1785393870.368736:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351296 00000100:00100000:0.0:1785393870.368775:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351552 00000100:00100000:0.0:1785393870.368778:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351552 00000100:00100000:0.0:1785393870.368795:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785393870.368802:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831351296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368845:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831351296:12345-0@lo:400:kworker.0 Request processed in 43us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393870.368852:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785393870.368866:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785393870.368872:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831351552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368897:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831351552:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393870.368902:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785393870.368917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831350912 00000100:00100000:0.0:1785393870.368920:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831350912 00000100:00100000:0.0:1785393870.368939:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1785393870.368945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831350912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.368969:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831350912:12345-0@lo:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393870.368974:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1785393870.369150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351424 00000100:00100000:0.0:1785393870.369159:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351424 00000100:00100000:0.0:1785393870.371603:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351040 00000100:00100000:0.0:1785393870.371613:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351040 00000100:00080000:3.0:1785393870.374674:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393870.374681:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393870.374684:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393870.375526:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351168 00000100:00100000:1.0:1785393870.375543:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351168 00000100:00100000:1.0:1785393870.375611:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1785393870.375620:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831351424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393870.375699:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831351424:12345-0@lo:400:kworker.0 Request processed in 80us (7142us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393870.375716:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1785393870.375733:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1785393870.375740:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831351040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393870.375772:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831351040:12345-0@lo:400:kworker.0 Request processed in 32us (7150us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393870.375778:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1785393870.375788:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1785393870.375794:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831351168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393870.375818:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831351168:12345-0@lo:400:kworker.0 Request processed in 24us (7111us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393870.375823:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1785393870.375838:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393870.381159:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831351168:0@lo:400:kworker.0 00000100:00100000:2.0:1785393870.381177:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831351040:0@lo:400:kworker.0 00010000:00080000:2.0:1785393870.381192:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7eb9500 x1872120831351552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393870.381203:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831351552:0@lo:400:kworker.0 00000100:00100000:2.0:1785393870.381243:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831350912:0@lo:400:kworker.0 00000100:00100000:2.0:1785393870.381272:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831351424:0@lo:400:kworker.0 00000100:00100000:2.0:1785393870.381283:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831351296:0@lo:400:kworker.0 00000100:00100000:0.0:1785393870.885843:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393870.885863:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831351680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393870.885920:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393870.886040:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351680 00000100:00100000:3.0:1785393870.886048:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351680 00000100:00100000:3.0:1785393870.886100:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785393870.886109:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831351680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393870.886142:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393870.886215:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831351680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393870.886221:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1785393870.886290:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acc7acbb80 x1872120831351680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393870.886308:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831351680:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1785393870.931215:0:11737:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:44:28 (1785393868) 00010000:00010000:1.0:1785393870.943741:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393871.391823:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393871.391846:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831351808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393871.391908:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393871.391979:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351808 00000100:00100000:2.0:1785393871.391985:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351808 00000100:00100000:2.0:1785393871.392028:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785393871.392036:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831351808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785393871.392068:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393871.392110:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831351808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393871.392118:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785393871.392160:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831351808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393871.967755:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393872.078368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393872.078410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393872.078438:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393872.078517:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190144 00000100:00100000:3.0:1785393872.078535:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190144 00000100:00100000:3.0:1785393872.078620:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190272 00000100:00100000:3.0:1785393872.078624:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190272 00000100:00100000:3.0:1785393872.078646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1785393872.078656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807190144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393872.078735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2359:x1872120807190144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 80us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393872.078742:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1785393872.078761:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:3.0:1785393872.078767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807190272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393872.078789:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807190272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393872.078795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00080000:2.0:1785393872.078853:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393872.079239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190016 00000100:00100000:1.0:1785393872.079243:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190016 00000100:00100000:1.0:1785393872.079276:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 303 00000100:00100000:1.0:1785393872.079282:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807190016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393872.079307:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807190016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393872.079313:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 303 00010000:00010000:3.0:1785393872.991849:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393873.467500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393873.469399:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190400 00000100:00100000:0.0:1785393873.469415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190400 00000100:00100000:0.0:1785393873.469496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:0.0:1785393873.469509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:10216:x1872120807190400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393873.469549:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393873.469622:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629c43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5f2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.469708:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.469724:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.469740:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393873.470764:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785393873.470771:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393873.471482:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.471533:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629c43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f2 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.473407:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f2 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.473421:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14a00) 00010000:00010000:0.0:1785393873.473424:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393873.473428:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045800, rc 0) 00000100:00100000:0.0:1785393873.473524:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:10216:x1872120807190400:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4008us (6028us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393873.473534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1785393873.487789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393873.487973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190528 00000100:00100000:0.0:1785393873.487985:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190528 00000100:00100000:0.0:1785393873.488054:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1785393873.488066:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:10217:x1872120807190528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393873.488096:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393873.488128:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd5f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488212:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488228:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488241:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488259:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488275:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488281:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488935:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488946:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.488954:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393873.489050:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1785393873.489054:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393873.489139:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489153:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489160:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489167:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489173:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393873.489177:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489191:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489205:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14a00) 00010000:00010000:0.0:1785393873.489208:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393873.489213:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489219:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629c58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489234:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489239:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489245:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489250:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393873.489252:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489258:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489263:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93acc7d14000) 00010000:00010000:0.0:1785393873.489266:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393873.489268:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489282:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629c5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b3629c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f9 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489337:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f9 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.489357:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:0.0:1785393873.489360:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393873.489362:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045400, rc 0) 00000100:00100000:0.0:1785393873.489787:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:10217:x1872120807190528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1720us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393873.489796:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1785393873.514800:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393873.514894:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190784 00000100:00100000:0.0:1785393873.514907:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190784 00000100:00100000:0.0:1785393873.514984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1785393873.514997:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:10217:x1872120807190784:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393873.515025:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393873.515053:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629c6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd600 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.515151:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.515167:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.515201:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.516707:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.516728:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.516792:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517506:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045600/0xcc9b96d8b3629c82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517529:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045600/0xcc9b96d8b3629c82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517537:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045600/0xcc9b96d8b3629c82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393873.517548:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1785393873.517890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517899:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517906:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517912:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393873.517922:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517931:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517947:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:0.0:1785393873.517950:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393873.517954:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517961:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629c74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517978:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517985:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517991:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.517997:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393873.518000:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518006:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518012:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93acc7d14b00) 00010000:00010000:0.0:1785393873.518014:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393873.518021:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629c7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518351:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629c6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd600 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518367:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045600/0xcc9b96d8b3629c82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd600 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393873.518374:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:0.0:1785393873.518377:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393873.518379:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045600, rc 0) 00000100:00100000:0.0:1785393873.521256:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10217:x1872120807190784:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 6255us (6463us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1785393873.521272:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1785393873.534534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393873.535455:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807190912 00000100:00100000:1.0:1785393873.535469:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807190912 00000100:00100000:1.0:1785393873.535592:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1785393873.535606:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10217:x1872120807190912:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1785393873.535803:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10217:x1872120807190912:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 199us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393873.535812:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00010000:00010000:1.0:1785393874.015895:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785393874.209244:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785393875.043491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393875.499255:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831352064:0@lo:400:kworker.0 00000100:00100000:0.0:1785393875.499486:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393875.499514:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831351936:0@lo:400:kworker.0 00000100:00100000:0.0:1785393875.499753:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393875.500022:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393875.500067:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352064 00000100:00100000:2.0:1785393875.500077:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352064 00000100:00100000:2.0:1785393875.500144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1785393875.500153:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831352064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500316:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831351936 00000100:00100000:3.0:1785393875.500321:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831351936 00000100:00100000:3.0:1785393875.500365:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1785393875.500372:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831351936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500425:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd81c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831351936:12345-0@lo:400:kworker.0 Request processed in 53us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393875.500441:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1785393875.500495:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831351936:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500608:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831352320:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500642:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393875.500673:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352320 00000100:00100000:3.0:1785393875.500677:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352320 00000100:00100000:3.0:1785393875.500714:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785393875.500720:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831352320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500754:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831352320:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393875.500760:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785393875.500788:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831352320:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500815:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831352448:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500838:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393875.500890:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831352192:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500913:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393875.500931:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393875.500936:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831352576:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.500955:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393875.500991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352448 00000100:00100000:3.0:1785393875.500995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352448 00000100:00100000:3.0:1785393875.501013:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352192 00000100:00100000:3.0:1785393875.501015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352192 00000100:00100000:3.0:1785393875.501029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1785393875.501035:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831352448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.501077:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831352448:12345-0@lo:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393875.501084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1785393875.501097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1785393875.501103:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831352192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.501140:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831352192:12345-0@lo:400:kworker.0 Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393875.501146:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1785393875.501163:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352576 00000100:00100000:3.0:1785393875.501167:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352576 00000100:00100000:3.0:1785393875.501191:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785393875.501197:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831352576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.501239:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831352576:12345-0@lo:400:kworker.0 Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393875.501245:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785393875.501271:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831352448:0@lo:400:kworker.0 00010000:00080000:3.0:1785393875.501292:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988700 x1872120831352576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785393891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393875.501304:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831352576:0@lo:400:kworker.0 00000100:00100000:3.0:1785393875.501313:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831352192:0@lo:400:kworker.0 00000100:00080000:3.0:1785393875.501336:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393875.501342:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393875.501344:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393875.501855:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831352064:12345-0@lo:400:kworker.0 Request processed in 1700us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393875.501863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1785393875.505118:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831352064:0@lo:400:kworker.0 00000100:00100000:3.0:1785393876.006552:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393876.006601:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831352704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393876.007108:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393876.015519:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352704 00000100:00100000:1.0:1785393876.015539:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352704 00000100:00100000:1.0:1785393876.016535:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785393876.016552:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831352704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393876.017035:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393876.018510:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831352704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1948us (11387us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393876.018526:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1785393876.025200:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988700 x1872120831352704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785393892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393876.025264:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831352704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393876.072805:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393876.513552:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831352832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393876.513660:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393876.513768:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831352832 00000100:00100000:3.0:1785393876.513777:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831352832 00000100:00100000:3.0:1785393876.513828:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785393876.513838:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831352832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393876.513880:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393876.513928:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831352832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393876.513935:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785393876.513988:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc12aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831352832:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1785393876.630051:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1785393876.684709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393876.684801:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191040 00000100:00100000:3.0:1785393876.684813:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191040 00000100:00080000:0.0:1785393876.684896:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393876.684902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1785393876.684915:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:10260:x1872120807191040:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785393876.684949:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393876.684973:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd607 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685077:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685094:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685107:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685125:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685132:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685140:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685519:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685527:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685534:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685541:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393876.685545:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685563:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685603:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14a00) 00010000:00010000:3.0:1785393876.685607:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393876.685612:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685619:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685634:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685640:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685647:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685652:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393876.685655:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685660:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93acd8302800) 00010000:00010000:3.0:1785393876.685669:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393876.685671:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685686:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629c9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685718:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629c90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd607 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685728:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14a00) 00010000:00010000:3.0:1785393876.685730:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393876.685734:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd607 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.685743:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0400, rc 0) 00000100:00100000:3.0:1785393876.685814:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:10260:x1872120807191040:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 901us (1118us total) trans 0 rc 301/301 00000100:00100000:3.0:1785393876.685821:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1785393876.697960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393876.698041:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191296 00000100:00100000:1.0:1785393876.698053:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191296 00000100:00100000:1.0:1785393876.698122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1785393876.698134:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:10260:x1872120807191296:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:1.0:1785393876.698206:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393876.698239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629c4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f2 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698258:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc7d14a00) 00010000:00010000:1.0:1785393876.698279:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393876.698809:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698825:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698836:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698847:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698854:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.698860:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393876.701756:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1785393876.701776:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.701787:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.701795:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.701801:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393876.701805:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.702345:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.702366:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc3c44600) 00010000:00010000:1.0:1785393876.702370:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393876.702376:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393876.702383:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629ca5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393876.702405:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000038cef5e reply state 000000005590ac44 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393876.702416:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393876.702769:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10260:x1872120807191296:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 4632us (4818us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1785393876.702779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:3.0:1785393876.727060:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727083:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727091:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727099:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393876.727105:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727114:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727151:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93acc3c44500) 00010000:00010000:3.0:1785393876.727155:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393876.727160:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.727167:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629cac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393876.882728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393876.883138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191424 00000100:00100000:3.0:1785393876.883151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191424 00000100:00100000:3.0:1785393876.883217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1785393876.883228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:10268:x1872120807191424:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:3.0:1785393876.883256:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393876.883284:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629cb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd60e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883671:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883686:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883698:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393876.883780:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785393876.883784:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393876.883830:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883872:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629cb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd60e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883890:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd60e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393876.883899:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:3.0:1785393876.883902:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785393876.883906:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1600, rc 0) 00000100:00100000:3.0:1785393876.884012:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10268:x1872120807191424:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 785us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393876.884020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1785393877.017262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.017357:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191552 00000100:00100000:1.0:1785393877.017369:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191552 00000100:00100000:1.0:1785393877.017435:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1785393877.017445:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:10274:x1872120807191552:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393877.017470:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393877.017505:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629cc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd615 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017624:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017658:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017673:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017689:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017695:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.017702:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018087:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018097:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018105:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393877.018142:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1785393877.018147:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393877.018194:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018208:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018216:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018223:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018230:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.018234:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018253:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018267:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:2.0:1785393877.018270:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393877.018275:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018282:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018297:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018304:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018310:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018315:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.018318:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018325:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018332:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93acc3c44600) 00010000:00010000:2.0:1785393877.018335:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393877.018338:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018353:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629ccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018385:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd615 expref: 11 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018397:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd615 expref: 10 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.018404:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393877.018406:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785393877.018408:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1200, rc 0) 00000100:00100000:2.0:1785393877.018475:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:10274:x1872120807191552:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1032us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393877.018481:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1785393877.026708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393877.026938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191808 00000100:00100000:2.0:1785393877.026950:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191808 00000100:00100000:2.0:1785393877.027021:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1785393877.027032:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:10274:x1872120807191808:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393877.027057:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393877.027083:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629cdd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd61c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027243:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027260:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027287:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027304:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027311:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.027317:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785393877.028031:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1785393877.028242:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028253:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028261:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028300:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028308:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028315:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028323:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.028334:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028343:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028355:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393877.028359:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393877.028363:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028369:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629ce4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393877.028383:0:5832:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065d16fc7 reply state 00000000b0ad90e3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393877.028393:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785393877.028422:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629cdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028437:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.028445:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:2.0:1785393877.028448:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393877.028450:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1800, rc 0) 00000100:00100000:2.0:1785393877.030662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10274:x1872120807191808:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3624us (3958us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1785393877.030672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1785393877.043075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393877.043195:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807191936 00000100:00100000:3.0:1785393877.043207:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807191936 00000100:00100000:3.0:1785393877.043259:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1785393877.043269:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1872120807191936:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:3.0:1785393877.043308:0:8307:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1785393877.043358:0:8307:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b3629d00 00002000:00100000:3.0:1785393877.043373:0:8307:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93ace00c6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1785393877.043385:0:8307:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1785393877.043703:0:8307:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1785393877.043737:0:8307:0:(import.c:65:import_set_state_nolock()) ffff93ace00c1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785393877.043812:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807191936:12345-192.168.203.12@tcp:8:bash.0 Request processed in 543us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393877.043821:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:0.0:1785393877.047691:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047711:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047735:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047741:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393877.047746:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047753:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047772:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc89f9b00) 00010000:00010000:0.0:1785393877.047775:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393877.047779:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.047785:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629ceb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393877.063933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393877.064031:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192064 00000100:00100000:3.0:1785393877.064042:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192064 00000100:00100000:3.0:1785393877.064124:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785393877.064134:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:0:x1872120807192064:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393877.064157:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393877.064181:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd623 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785393877.064212:0:6630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785393877.064234:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1785393877.064238:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393877.064248:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.064267:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.064283:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0400, rc 0) 00000100:00100000:3.0:1785393877.064357:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:0:x1872120807192064:12345-192.168.203.12@tcp:101:bash.0 Request processed in 223us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393877.064363:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:0.0:1785393877.064425:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393877.068709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393877.069099:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192192 00000100:00100000:3.0:1785393877.069110:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192192 00000100:00100000:3.0:1785393877.069176:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1785393877.069188:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:10274:x1872120807192192:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393877.069214:0:8307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393877.069250:0:8307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd62a expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.069287:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 8 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.069297:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393877.069302:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393877.069308:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 8 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.069350:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 8 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.069365:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 8 pid: 6630 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393877.069380:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8307:1872120831352960:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393877.069504:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57000 going to sleep for 11 seconds 00000100:00100000:2.0:1785393877.077901:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.077987:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192320 00000100:00100000:1.0:1785393877.077998:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192320 00010000:00010000:1.0:1785393877.078092:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 9 pid: 6630 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.078141:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1785393877.078152:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807192320:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393877.078168:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393877.078193:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 9 pid: 6630 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.078208:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 9 pid: 6630 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.078255:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393877.078260:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393877.078269:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.078279:0:6645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.078324:0:6645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.078341:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831353088:192.168.203.12@tcp:105: 00000100:00100000:1.0:1785393877.078437:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1785393877.079291:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb41d983/0xcc9b96d8b3629d07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd623 expref: 9 pid: 6630 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393877.079311:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8307:1872120831352960:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393877.079340:0:8307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 8 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.079370:0:8307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785393877.079422:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:10274:x1872120807192192:12345-192.168.203.12@tcp:101:bash.0 Request processed in 10235us (10722us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393877.079430:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1785393877.081727:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831353088:192.168.203.12@tcp:105: 00010000:00010000:1.0:1785393877.081754:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393877.081804:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807192320:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 3654us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393877.081815:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00010000:00010000:1.0:1785393877.088087:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393877.093553:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.093905:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192576 00000100:00100000:1.0:1785393877.093919:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192576 00000100:00100000:1.0:1785393877.093994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785393877.094006:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:10274:x1872120807192576:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1785393877.094456:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10274:x1872120807192576:12345-192.168.203.12@tcp:35:bash.0 Request processed in 450us (914us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1785393877.094482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785393877.189296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393877.189349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.189435:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192704 00000100:00100000:0.0:1785393877.189446:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192704 00000100:00100000:0.0:1785393877.189514:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00100000:0.0:1785393877.189524:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807192704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393877.189651:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807192704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393877.189660:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00100000:1.0:1785393877.190007:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807192832 00000100:00100000:1.0:1785393877.190012:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807192832 00000100:00100000:1.0:1785393877.190073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1785393877.190082:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807192832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393877.190118:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807192832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393877.190124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00080000:0.0:1785393877.190475:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393877.230942:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.231038:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807193088 00000100:00100000:1.0:1785393877.231051:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807193088 00000100:00100000:1.0:1785393877.231127:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1785393877.231139:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10284:x1872120807193088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393877.231176:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393877.231203:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393877.231354:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1785393877.231507:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629d15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd631 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.231524:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:1.0:1785393877.231527:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393877.231533:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd631 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.231549:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42600, rc 0) 00000100:00100000:1.0:1785393877.231686:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10284:x1872120807193088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 549us (755us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1785393877.231694:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1785393877.234517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.235458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807193344 00000100:00100000:1.0:1785393877.235469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807193344 00000100:00100000:1.0:1785393877.235540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1785393877.235551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10284:x1872120807193344:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393877.236410:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10284:x1872120807193344:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 858us (1903us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1785393877.236420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1785393877.344144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.344389:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807193472 00000100:00100000:1.0:1785393877.344402:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807193472 00000100:00100000:1.0:1785393877.344481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1785393877.344503:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10290:x1872120807193472:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393877.344536:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393877.344772:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd638 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.344871:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.344888:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.344902:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393877.345657:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1785393877.345663:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393877.345697:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.345730:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd638 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.345751:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd638 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.345761:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393877.345763:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393877.345767:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43400, rc 0) 00000100:00100000:0.0:1785393877.345838:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:10290:x1872120807193472:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1348us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393877.345845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1785393877.358853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.358933:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807193728 00000100:00100000:1.0:1785393877.358953:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807193728 00000100:00100000:1.0:1785393877.359112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1785393877.359124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:10290:x1872120807193728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393877.359150:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393877.359174:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.359290:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.359304:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.359316:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393877.359339:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785393877.359500:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd63f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.359523:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd63f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.359533:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:1.0:1785393877.359536:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393877.359539:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43e00, rc 0) 00000100:00100000:1.0:1785393877.359669:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:10290:x1872120807193728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 546us (829us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1785393877.359677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1785393877.372769:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393877.372998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.375904:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194112 00000100:00100000:1.0:1785393877.375920:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194112 00000100:00100000:1.0:1785393877.376033:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1785393877.376045:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2360:x1872120807194112:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393877.376091:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393877.376122:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd63f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.376147:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:1.0:1785393877.376153:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393877.376225:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:2360:x1872120807194112:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 182us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393877.376233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1785393877.378693:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807193984 00000100:00100000:3.0:1785393877.378709:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807193984 00000100:00100000:3.0:1785393877.378829:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1785393877.378840:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:10290:x1872120807193984:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785393877.378871:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393877.378895:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629d46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd646 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.380471:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.380502:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.380516:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393877.380533:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785393877.380718:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b3629d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd646 expref: 20 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.380739:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd646 expref: 19 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.380770:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:3.0:1785393877.380774:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785393877.380778:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393877.388507:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10290:x1872120807193984:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 9647us (15728us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1785393877.388522:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1785393877.402533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393877.402647:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194240 00000100:00100000:3.0:1785393877.402660:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194240 00000100:00100000:1.0:1785393877.402751:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1785393877.402766:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807194240:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1785393877.402829:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.402853:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 7 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.402862:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393877.402866:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393877.402870:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.402912:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 7 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.402946:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 7 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.402964:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831353216:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393877.403075:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785393877.404870:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831353216:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393877.404902:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393877.408274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.408629:0:6635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194368 00000100:00100000:1.0:1785393877.408644:0:6635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194368 00002000:00100000:1.0:1785393877.408706:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93acc848ad80 x1872120807194368/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:88/0 lens 504/0 e 0 to 0 dl 1785393888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785393877.408720:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acc848ad80 with x1872120807194368 ext(0->12) 00010000:00010000:1.0:1785393877.408732:0:6635:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 8 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.408754:0:6635:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 8 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785393877.408763:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acc848ad80 00000100:00100000:1.0:1785393877.408792:0:6635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785393877.408802:0:6635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807194368:12345-192.168.203.12@tcp:4:lfs.0 00000001:00100000:1.0:1785393877.537320:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000100:00100000:0.0:1785393877.538242:0:6635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807194368:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 129433us (129969us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1785393877.538263:0:6635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:0.0:1785393877.538279:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93acc848ad80 x1872120807194368/t4294967299(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:88/0 lens 504/448 e 0 to 0 dl 1785393888 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393877.538290:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acc848ad80 with x1872120807194368 ext(0->12) 00010000:00010000:0.0:1785393877.538304:0:6635:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.538324:0:6635:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393877.538345:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acc848ad80 00000100:00100000:2.0:1785393877.552260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.558136:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194496 00000100:00100000:0.0:1785393877.558153:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194496 00010000:00010000:0.0:1785393877.558216:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393877.558259:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1785393877.558269:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2361:x1872120807194496:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393877.558286:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785393877.558309:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1785393877.558312:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785393876 00002000:00010000:0.0:1785393877.558315:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1785393876 00002000:00010000:0.0:1785393877.558317:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785393876 00010000:00010000:0.0:1785393877.558323:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.558338:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.558369:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cfae53d/0xcc9b96d8b3629d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd62a expref: 9 pid: 8307 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.558391:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785393877.558396:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785393877.558404:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.558433:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.558478:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393877.558661:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2361:x1872120807194496:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 392us (6412us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393877.558670:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:2.0:1785393877.559086:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559097:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559128:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559138:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559146:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559163:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393877.559168:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559178:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559191:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.559198:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe502a24/0xcc9b96d8b3629d5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393877.559255:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807194240:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 156494us (156734us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393877.559263:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1785393877.571218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.571308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194752 00000100:00100000:0.0:1785393877.571328:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194752 00000100:00100000:0.0:1785393877.571391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1785393877.571401:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10290:x1872120807194752:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1785393877.571496:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd646 expref: 19 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393877.572179:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1785393877.572244:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1785393877.578713:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1785393877.578916:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.578941:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.578953:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.579180:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.579200:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 23 pid: 5832 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.579218:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831353344:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393877.579401:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393877.587054:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831353344:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393877.587093:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393877.589937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.604636:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807194880 00000100:00100000:1.0:1785393877.604656:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807194880 00010000:00010000:1.0:1785393877.604722:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 24 pid: 5832 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.604807:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1785393877.604819:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:2359:x1872120807194880:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393877.604840:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393877.604848:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 24 pid: 5832 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604862:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 24 pid: 5832 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604888:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd61c expref: 24 pid: 5832 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604907:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:1.0:1785393877.604912:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604922:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604930:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.604980:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393877.605072:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:2359:x1872120807194880:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 255us (15147us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393877.605081:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00010000:00010000:2.0:1785393877.605721:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.605732:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393877.605881:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1785393877.606119:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1785393877.606233:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831353472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393877.606296:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393877.606343:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1785393877.606549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831353472 00000100:00100000:3.0:1785393877.606555:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831353472 00000100:00100000:3.0:1785393877.606648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785393877.606655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831353472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785393877.606729:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831353472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393877.606736:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1785393877.606960:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393877.607132:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831353472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1785393877.608289:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1785393877.608375:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831353600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785393877.608700:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393877.608740:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57480 going to sleep for 11 seconds 00000100:00100000:2.0:1785393877.609265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831353600 00000100:00100000:2.0:1785393877.609272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831353600 00000100:00100000:2.0:1785393877.609324:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785393877.609332:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831353600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393877.609999:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1872120831353600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 665us (1297us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1785393877.610013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785393877.610197:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831353600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1785393877.610262:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1785393877.610307:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610343:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610351:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610359:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393877.610369:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610378:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610396:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:3.0:1785393877.610399:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1785393877.610404:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393877.610731:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629d62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785393877.611187:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1785393877.612155:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1785393877.612170:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409643599006ns, next at 410643595988ns, rc = 0 00000001:00080000:3.0:1785393877.612180:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1785393877.612229:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:3.0:1785393877.612233:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785393877.612243:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629d4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd646 expref: 27 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393877.613153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:10290:x1872120807194752:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 41747us (41942us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1785393877.613166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000020:00080000:3.0:1785393877.613173:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785393877.617157:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.617230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807195008 00000100:00100000:1.0:1785393877.617252:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807195008 00000100:00100000:1.0:1785393877.617332:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1785393877.617345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:10290:x1872120807195008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393877.617380:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393877.617409:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.617483:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd64d expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393877.617798:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd64d expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.618017:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393877.618022:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393877.618026:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43e00, rc 0) 00000100:00100000:0.0:1785393877.618102:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:10290:x1872120807195008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 759us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393877.618109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1785393877.623192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393877.623293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807195264 00000100:00100000:1.0:1785393877.623307:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807195264 00000100:00100000:1.0:1785393877.623379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1785393877.623389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:10290:x1872120807195264:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393877.624118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:10290:x1872120807195264:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 727us (935us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1785393877.624154:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1785393877.780855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.787064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807195520 00000100:00100000:0.0:1785393877.787084:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807195520 00000100:00100000:0.0:1785393877.787234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1785393877.787261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:10301:x1872120807195520:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393877.787292:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393877.787319:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd654 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393877.787470:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1785393877.787665:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd654 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.787682:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393877.787686:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785393877.787692:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd654 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.787709:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393877.787807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10301:x1872120807195520:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 548us (6965us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1785393877.787816:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1785393877.815331:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.820166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807195648 00000100:00100000:0.0:1785393877.820185:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807195648 00000100:00100000:0.0:1785393877.820306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1785393877.820319:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10301:x1872120807195648:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1785393877.820416:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820435:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820468:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820498:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820506:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820516:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820664:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820681:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393877.820731:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820745:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820752:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820760:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820776:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393877.820795:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820804:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820818:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393877.820822:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393877.820827:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820834:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820848:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820855:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820862:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820866:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393877.820870:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820876:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820893:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc7d14b00) 00010000:00010000:0.0:1785393877.820895:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393877.820898:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820905:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820920:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820925:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820931:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820937:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393877.820940:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820946:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820952:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393877.820954:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393877.820956:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393877.820962:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b3629d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393877.821541:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10301:x1872120807195648:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1214us (6211us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393877.821551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1785393877.826321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393877.830882:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807195904 00000100:00100000:3.0:1785393877.830900:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807195904 00000100:00100000:3.0:1785393877.831093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1785393877.831105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10301:x1872120807195904:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1785393877.831417:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:10301:x1872120807195904:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 315us (5111us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1785393877.831425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1785393877.952899:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393877.953049:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807196160 00000100:00100000:2.0:1785393877.953061:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807196160 00000100:00100000:2.0:1785393877.953130:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1785393877.953141:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:10304:x1872120807196160:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393877.953171:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393877.953195:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd65b expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953280:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953296:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953327:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953344:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953352:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953359:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953503:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953512:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953519:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393877.953531:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785393877.953702:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953710:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953717:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953724:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.953735:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953744:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953758:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393877.953762:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393877.953767:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953775:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953802:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953808:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953815:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953821:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.953824:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953831:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953839:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc89f9f00) 00010000:00010000:2.0:1785393877.953841:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393877.953850:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953856:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953902:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 33 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953915:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 32 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.953924:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393877.953927:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393877.953929:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393877.954002:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10304:x1872120807196160:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 862us (1115us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1785393877.954010:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1785393877.963454:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393877.963614:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807196288 00000100:00100000:2.0:1785393877.963628:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807196288 00000100:00100000:2.0:1785393877.963703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1785393877.963716:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10304:x1872120807196288:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1785393877.963817:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963837:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963851:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963903:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963910:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963917:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963924:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393877.963929:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963936:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963948:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393877.963951:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393877.963956:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393877.963962:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629db6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393877.964170:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10304:x1872120807196288:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 456us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393877.964186:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1785393877.970926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393877.971030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807196544 00000100:00100000:0.0:1785393877.971042:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807196544 00000100:00100000:0.0:1785393877.971105:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1785393877.971116:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10304:x1872120807196544:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393877.971421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:10304:x1872120807196544:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 306us (508us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1785393877.971430:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:2.0:1785393878.111798:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393878.304633:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1785393878.456313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393878.456465:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807196800 00000100:00100000:2.0:1785393878.456478:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807196800 00000100:00100000:2.0:1785393878.456641:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1785393878.456654:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:10335:x1872120807196800:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1785393878.456687:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393878.456714:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd662 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.456841:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.456856:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.456869:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393878.456881:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785393878.457051:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd662 expref: 36 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.457072:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd662 expref: 35 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.457080:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393878.457083:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393878.457087:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:2.0:1785393878.457152:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10335:x1872120807196800:12345-192.168.203.12@tcp:101:cat.0 Request processed in 503us (853us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1785393878.457159:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00080000:0.0:1785393878.457219:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393878.471033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393878.471091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393878.471238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197056 00000100:00100000:0.0:1785393878.471249:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197056 00000100:00100000:0.0:1785393878.471318:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1785393878.471331:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10335:x1872120807197056:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1785393878.471698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:10335:x1872120807197056:12345-192.168.203.12@tcp:35:cat.0 Request processed in 369us (677us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1785393878.471706:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1785393878.479379:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197184 00000100:00100000:2.0:1785393878.479419:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197184 00000100:00100000:2.0:1785393878.479524:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1785393878.479540:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd8eff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:2360:x1872120807197184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393878.479561:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393878.479617:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd662 expref: 36 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.479641:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393878.479647:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393878.479727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd8eff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:2360:x1872120807197184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 193us (8634us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393878.479734:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1785393878.567728:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393878.567907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197440 00000100:00100000:2.0:1785393878.567928:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197440 00000100:00100000:2.0:1785393878.568000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1785393878.568011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10341:x1872120807197440:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1785393878.568041:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393878.568045:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785393878.568089:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd638 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568114:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393878.568119:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785393878.568135:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568257:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568287:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 35 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568297:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568335:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 35 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.568352:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 35 pid: 10972 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393878.568379:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831353728:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393878.568502:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785393878.579645:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831353728:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393878.579686:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393878.579780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393878.579859:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197568 00000100:00100000:1.0:1785393878.579869:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197568 00010000:00010000:1.0:1785393878.579925:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 36 pid: 10972 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393878.580037:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1785393878.580049:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:2359:x1872120807197568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393878.580069:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393878.580078:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 36 pid: 10972 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580091:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 36 pid: 10972 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580117:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd65b expref: 36 pid: 10972 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580135:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393878.580140:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580150:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580157:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.580190:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393878.580257:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:2359:x1872120807197568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 209us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393878.580264:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00010000:00010000:2.0:1785393878.580325:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.580333:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393878.580355:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785393878.580601:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629dd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.580631:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.580639:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393878.580642:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785393878.580645:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393878.580674:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10341:x1872120807197440:12345-192.168.203.12@tcp:101:dd.0 Request processed in 12665us (12960us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1785393878.580682:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1785393878.591989:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393878.592070:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197824 00000100:00100000:2.0:1785393878.592082:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197824 00000100:00100000:2.0:1785393878.592152:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1785393878.592164:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10341:x1872120807197824:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:2.0:1785393878.592544:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.592565:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393878.592632:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393878.592714:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1785393878.592739:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049fe5652 reply state 00000000f051d73b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393878.592748:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785393878.592848:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:10341:x1872120807197824:12345-192.168.203.12@tcp:36:dd.0 Request processed in 685us (873us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1785393878.592855:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000020:00080000:2.0:1785393878.592860:0:10972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785393878.600004:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600038:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600047:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600054:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393878.600060:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600068:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600088:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393878.600091:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393878.600097:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393878.600103:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629de7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.136173:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393879.158987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393879.159383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807197952 00000100:00100000:1.0:1785393879.159394:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807197952 00000100:00100000:1.0:1785393879.159532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1785393879.159545:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:10355:x1872120807197952:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:1.0:1785393879.159612:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393879.159649:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd670 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159731:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159763:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159775:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159793:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159800:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159806:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159926:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159938:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159948:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.159986:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393879.160002:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 38 pid: 5832 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393879.160031:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831353856:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393879.160147:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393879.171600:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831353856:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393879.171649:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393879.181837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.182044:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807198208 00000100:00100000:2.0:1785393879.182057:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807198208 00000100:00100000:2.0:1785393879.182129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1785393879.182141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:5580:x1872120807198208:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1785393879.182776:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:5580:x1872120807198208:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 636us (952us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1785393879.182786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393879.191823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.196288:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807198336 00000100:00100000:2.0:1785393879.196392:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807198336 00010000:00010000:2.0:1785393879.196460:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 40 pid: 5832 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393879.196603:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1785393879.196614:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:2358:x1872120807198336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393879.196640:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393879.196648:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 40 pid: 5832 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196664:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 40 pid: 5832 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196690:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd669 expref: 40 pid: 5832 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196729:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393879.196735:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196748:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196756:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.196791:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393879.196856:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:2358:x1872120807198336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 244us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393879.196864:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00010000:00010000:3.0:1785393879.199933:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.199968:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393879.200027:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1785393879.200032:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393879.200077:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200094:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200105:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200112:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200120:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200125:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393879.200140:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200150:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200165:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:3.0:1785393879.200169:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393879.200173:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200188:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b3629df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200207:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200213:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200219:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200223:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393879.200226:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200232:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200239:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44e00) 00010000:00010000:3.0:1785393879.200241:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393879.200244:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200248:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b3629dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200296:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b3629dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd670 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200313:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd670 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393879.200329:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:3.0:1785393879.200332:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393879.200335:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152ac00, rc 0) 00000100:00100000:3.0:1785393879.200421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:10355:x1872120807197952:12345-192.168.203.12@tcp:101:stat.0 Request processed in 40878us (41515us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393879.200430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1785393879.435348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.436007:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807198592 00000100:00100000:2.0:1785393879.436020:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807198592 00000100:00100000:2.0:1785393879.436086:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1785393879.436097:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:10361:x1872120807198592:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1785393879.436167:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393879.436199:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd670 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.436221:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393879.436226:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785393879.436482:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.436500:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.436520:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393879.436628:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1785393879.436664:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d7bd379 reply state 0000000015ecb269 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393879.436675:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785393879.436797:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:10361:x1872120807198592:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 701us (1461us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1785393879.436805:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000020:00080000:2.0:1785393879.436809:0:10972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785393879.439008:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439021:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439027:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439032:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393879.439036:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439045:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439069:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393879.439072:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393879.439087:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.439092:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393879.733323:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.733483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807198720 00000100:00100000:2.0:1785393879.733494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807198720 00000100:00100000:2.0:1785393879.733611:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1785393879.733625:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:10375:x1872120807198720:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1785393879.733663:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393879.733690:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733772:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733788:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733800:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733817:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733825:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.733831:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734032:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734042:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734050:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393879.734091:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1785393879.734096:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393879.734121:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734133:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734143:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734150:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734157:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734163:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393879.734168:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734176:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734195:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393879.734198:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393879.734203:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734210:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734223:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734228:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734234:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734239:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393879.734242:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734248:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734255:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc89f9f00) 00010000:00010000:2.0:1785393879.734258:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393879.734260:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734266:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734312:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734326:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.734333:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393879.734335:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393879.734338:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393879.735338:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:10375:x1872120807198720:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1713us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393879.735354:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1785393879.902765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.902869:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807198976 00000100:00100000:2.0:1785393879.902880:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807198976 00000100:00100000:2.0:1785393879.902957:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1785393879.902968:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:10385:x1872120807198976:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393879.902995:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393879.903023:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd67e expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393879.903165:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1785393879.903321:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd67e expref: 42 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.903338:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:2.0:1785393879.903341:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393879.903370:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd67e expref: 42 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393879.903387:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393879.903465:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:10385:x1872120807198976:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 498us (712us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1785393879.903480:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1785393879.908958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393879.909073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807199232 00000100:00100000:2.0:1785393879.909086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807199232 00000100:00100000:2.0:1785393879.909152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1785393879.909164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:10385:x1872120807199232:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393879.909512:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+42:10385:x1872120807199232:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 349us (565us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1785393879.909520:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785393880.133245:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393880.134099:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807199488 00000100:00100000:1.0:1785393880.134114:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807199488 00000100:00100000:1.0:1785393880.134204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1785393880.134215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+42:10391:x1872120807199488:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393880.134253:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393880.134277:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629e3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.134413:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.134431:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.134441:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.134487:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.134502:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 43 pid: 5832 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393880.134529:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831353984:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393880.134651:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7c00 going to sleep for 11 seconds 00000100:00080000:0.0:1785393880.138166:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393880.143690:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831353984:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393880.143729:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393880.144441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393880.146319:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807199616 00000100:00100000:0.0:1785393880.146331:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807199616 00010000:00010000:0.0:1785393880.146391:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 44 pid: 5832 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393880.146433:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1785393880.146442:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+44:2358:x1872120807199616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393880.146498:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393880.146507:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 44 pid: 5832 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.146523:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 44 pid: 5832 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.146551:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd677 expref: 44 pid: 5832 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.146626:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393880.146633:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.146644:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.146652:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.147199:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393880.147268:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:2358:x1872120807199616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 825us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393880.147277:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00010000:00010000:2.0:1785393880.154425:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.154453:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393880.154489:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1785393880.154986:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629e3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.155099:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.155110:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393880.155128:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785393880.155132:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152ac00, rc 0) 00000100:00100000:2.0:1785393880.155244:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:10391:x1872120807199488:12345-192.168.203.12@tcp:101:bash.0 Request processed in 21030us (22018us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1785393880.155254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00010000:00010000:1.0:1785393880.163893:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393880.168651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.168761:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807199872 00000100:00100000:2.0:1785393880.168774:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807199872 00000100:00100000:2.0:1785393880.168850:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1785393880.168860:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:10391:x1872120807199872:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1785393880.169256:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.169281:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.169294:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393880.169623:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1785393880.169677:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b78d28f6 reply state 0000000025d6736b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393880.169688:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785393880.169797:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:10391:x1872120807199872:12345-192.168.203.12@tcp:36:bash.0 Request processed in 937us (1158us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1785393880.169806:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000020:00080000:2.0:1785393880.169811:0:10972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785393880.174789:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174810:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174819:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174827:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393880.174833:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174841:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174861:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393880.174864:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393880.174869:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.174877:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629e50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393880.188041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.189050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807200000 00000100:00100000:2.0:1785393880.189062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807200000 00000100:00100000:2.0:1785393880.189138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1785393880.189166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+45:10391:x1872120807200000:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393880.189199:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393880.189233:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd68c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.189352:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.189369:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.189378:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.189418:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.189433:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 46 pid: 5833 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393880.189456:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831354112:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393880.189562:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785393880.200165:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831354112:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393880.200204:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393880.204621:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393880.205386:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807200128 00000100:00100000:1.0:1785393880.205398:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807200128 00010000:00010000:1.0:1785393880.205455:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 47 pid: 5833 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393880.205509:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1785393880.205519:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:2359:x1872120807200128:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393880.205536:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393880.205544:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 47 pid: 5833 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205560:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 47 pid: 5833 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205605:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629e42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd685 expref: 47 pid: 5833 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205625:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393880.205632:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205644:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205653:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.205689:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393880.205764:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:2359:x1872120807200128:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 247us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393880.205774:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:0.0:1785393880.205881:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.205891:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393880.205961:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1785393880.205965:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393880.205993:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.206598:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b3629e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd68c expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.206618:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd68c expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.206626:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393880.206629:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393880.206632:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:0.0:1785393880.206660:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+45:10391:x1872120807200000:12345-192.168.203.12@tcp:101:bash.0 Request processed in 17498us (18635us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393880.206668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1785393880.221318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.222613:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807200384 00000100:00100000:2.0:1785393880.222626:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807200384 00000100:00100000:2.0:1785393880.222719:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1785393880.222731:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd041c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+45:10391:x1872120807200384:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1785393880.223043:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd041c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:10391:x1872120807200384:12345-192.168.203.12@tcp:35:bash.0 Request processed in 313us (1739us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1785393880.223051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1785393880.391903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.394859:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807200640 00000100:00100000:2.0:1785393880.394876:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807200640 00000100:00100000:2.0:1785393880.394954:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1785393880.394965:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:10401:x1872120807200640:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393880.395013:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393880.395040:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd693 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393880.395182:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1785393880.395338:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd693 expref: 48 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.395364:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:2.0:1785393880.395367:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393880.395372:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd693 expref: 48 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.395388:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0400, rc 0) 00000100:00100000:2.0:1785393880.395476:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10401:x1872120807200640:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 503us (3576us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1785393880.395484:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1785393880.400748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.401175:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807200768 00000100:00100000:2.0:1785393880.401202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807200768 00000100:00100000:2.0:1785393880.401277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1785393880.401287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10401:x1872120807200768:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1785393880.401391:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401410:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401423:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401438:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401815:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401824:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401943:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401952:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.401959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393880.402212:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402289:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402297:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402304:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402310:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393880.402314:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402322:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402335:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393880.402338:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393880.402431:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.402439:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404122:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404132:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404139:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404155:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393880.404158:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404165:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404176:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc89f9f00) 00010000:00010000:2.0:1785393880.404179:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393880.404183:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404189:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404207:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404213:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404219:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.404223:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393880.404226:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.405077:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.405098:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393880.405100:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393880.405104:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.405110:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393880.405226:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10401:x1872120807200768:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 3935us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393880.407104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1785393880.439912:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.452833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807201024 00000100:00100000:2.0:1785393880.452853:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807201024 00000100:00100000:1.0:1785393880.453034:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1785393880.453045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10401:x1872120807201024:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393880.453416:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+48:10401:x1872120807201024:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 361us (13507us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1785393880.453425:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1785393880.608955:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831354496:0@lo:400:kworker.0 00000100:00100000:0.0:1785393880.609048:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393880.609125:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785393880.609131:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831354368:0@lo:400:kworker.0 00000100:00100000:0.0:1785393880.609153:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393880.609171:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831354880:0@lo:400:kworker.0 00000100:00100000:0.0:1785393880.609196:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393880.609251:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354880 00000100:00100000:0.0:1785393880.609260:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354880 00000100:00100000:0.0:1785393880.609591:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785393880.609606:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831354880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393880.609669:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831354880:12345-0@lo:400:kworker.0 Request processed in 66us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393880.609677:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785393880.609706:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354496 00000100:00100000:0.0:1785393880.609710:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354496 00000100:00100000:0.0:1785393880.609737:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354368 00000100:00100000:0.0:1785393880.609740:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354368 00000100:00100000:0.0:1785393880.609758:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1785393880.609764:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831354496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.610021:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831354240:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.610061:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393880.610101:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831354752:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.610138:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393880.610153:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393880.610159:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831354624:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.610185:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393880.610211:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354624 00000100:00100000:3.0:1785393880.610215:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354624 00000100:00100000:3.0:1785393880.610253:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785393880.610261:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd7e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831354624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.610318:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd7e10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831354624:12345-0@lo:400:kworker.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393880.610325:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785393880.610985:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831354624:0@lo:400:kworker.0 00000100:00080000:3.0:1785393880.611027:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393880.611032:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393880.611035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393880.611050:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831354880:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611061:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831354496:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611078:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354752 00000100:00100000:3.0:1785393880.611080:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354752 00000100:00100000:3.0:1785393880.611104:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1785393880.611110:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831354368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611145:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831354368:12345-0@lo:400:kworker.0 Request processed in 35us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393880.611150:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1785393880.611161:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1785393880.611166:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831354752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611189:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831354752:12345-0@lo:400:kworker.0 Request processed in 24us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393880.611194:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1785393880.611204:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393880.611218:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831354752:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611235:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831354368:0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831354240 00000100:00100000:3.0:1785393880.611296:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831354240 00000100:00100000:3.0:1785393880.611321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1785393880.611327:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831354240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393880.611377:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accb309450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831354240:12345-0@lo:400:kworker.0 Request processed in 50us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393880.611384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1785393880.611414:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831354240:0@lo:400:kworker.0 00000100:00100000:0.0:1785393880.612103:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831354496:12345-0@lo:400:kworker.0 Request processed in 2338us (3054us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393880.612111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1785393880.628219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393880.628729:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807201280 00000100:00100000:2.0:1785393880.628742:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807201280 00000100:00100000:2.0:1785393880.628816:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1785393880.628827:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+48:10404:x1872120807201280:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393880.628859:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393880.628884:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd69a expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.628984:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629001:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629013:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629050:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629058:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629065:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629225:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629235:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629242:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393880.629253:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1785393880.629384:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629392:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629400:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629418:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393880.629423:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629443:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629473:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:2.0:1785393880.629477:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393880.629482:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629488:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629504:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629510:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629524:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629530:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393880.629533:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629539:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.629547:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc89f9f00) 00010000:00010000:2.0:1785393880.629549:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393880.629552:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.630893:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b3629e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.630961:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629e88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd69a expref: 51 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.630976:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd69a expref: 50 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393880.630984:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393880.630986:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393880.630989:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0400, rc 0) 00000100:00100000:2.0:1785393880.631071:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10404:x1872120807201280:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2245us (2867us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1785393880.631081:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1785393880.637907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393880.637959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393880.638847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807201408 00000100:00100000:1.0:1785393880.638860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807201408 00000100:00100000:1.0:1785393880.638942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1785393880.638953:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10404:x1872120807201408:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1785393880.639045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639067:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639080:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639115:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639133:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639141:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639162:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152ac00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393880.639167:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639175:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639187:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393880.639190:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393880.639194:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393880.639200:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393880.639289:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10404:x1872120807201408:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 338us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393880.639296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1785393880.641736:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807201536 00000100:00100000:0.0:1785393880.641750:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807201536 00000100:00100000:0.0:1785393880.641849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1785393880.641858:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:2359:x1872120807201536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393880.641873:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393880.641895:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b3629e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd69a expref: 50 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393880.641938:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393880.641943:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393880.641998:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:2359:x1872120807201536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 141us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393880.642022:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1785393880.656855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393880.661956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807201792 00000100:00100000:1.0:1785393880.661975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807201792 00000100:00100000:1.0:1785393880.662053:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1785393880.662065:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:10404:x1872120807201792:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393880.662631:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10404:x1872120807201792:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 566us (5786us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1785393880.662640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1785393881.000951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.003235:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202048 00000100:00100000:3.0:1785393881.003251:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202048 00000100:00100000:3.0:1785393881.003344:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1785393881.003357:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10422:x1872120807202048:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1785393881.003389:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393881.003417:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6a1 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.003609:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629eb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.003629:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.003645:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393881.003677:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785393881.003851:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a1 expref: 53 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.003872:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a1 expref: 52 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.003882:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:3.0:1785393881.003884:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785393881.003889:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1000, rc 0) 00000100:00100000:3.0:1785393881.003964:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10422:x1872120807202048:12345-192.168.203.12@tcp:101:cat.0 Request processed in 609us (3025us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1785393881.003972:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1785393881.058081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.059625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202176 00000100:00100000:1.0:1785393881.059639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202176 00000100:00100000:1.0:1785393881.059717:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1785393881.059755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10423:x1872120807202176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393881.059788:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393881.059825:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6a8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.059936:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.059953:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.059965:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393881.060038:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1785393881.060042:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393881.060069:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.060101:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a8 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.060124:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a8 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.060133:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393881.060136:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393881.060140:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152ac00, rc 0) 00000100:00100000:1.0:1785393881.060219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10423:x1872120807202176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 474us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.060236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1785393881.063441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393881.063633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202560 00000100:00100000:2.0:1785393881.063642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202560 00000100:00100000:2.0:1785393881.063701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785393881.063712:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10423:x1872120807202560:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393881.064058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10423:x1872120807202560:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 348us (626us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1785393881.064067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785393881.067835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.067908:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202688 00000100:00100000:1.0:1785393881.067919:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202688 00000100:00100000:1.0:1785393881.067983:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785393881.067994:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10423:x1872120807202688:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1785393881.068011:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785393881.068041:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd68c expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.068067:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a1 expref: 53 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.068081:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b3629d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd64d expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.068094:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393881.068105:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393881.068246:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:10423:x1872120807202688:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 253us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.068260:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785393881.080705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.080836:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202816 00000100:00100000:3.0:1785393881.080848:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202816 00000100:00100000:3.0:1785393881.080916:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1785393881.080928:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:10423:x1872120807202816:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:3.0:1785393881.081059:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.081077:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.081089:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785393881.081432:0:10972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785393881.081892:0:10972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1785393881.081965:0:10972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1785393881.082126:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:10423:x1872120807202816:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 1199us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393881.082135:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000004:00080000:3.0:1785393881.119822:0:7785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413151247949ns, next at 414151244917ns, rc = 0 00000100:00100000:2.0:1785393881.120352:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393881.120382:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831355008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393881.120500:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393881.120740:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831355008 00000100:00100000:1.0:1785393881.120750:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831355008 00000100:00100000:1.0:1785393881.120801:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785393881.120812:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1872120831355008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393881.120867:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393881.120927:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1872120831355008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.120935:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1785393881.121452:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831355008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393881.152023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.155071:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807202944 00000100:00100000:1.0:1785393881.155089:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807202944 00000100:00100000:1.0:1785393881.155247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1785393881.155260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:10425:x1872120807202944:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393881.155289:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393881.155326:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6af expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155410:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155428:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155442:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155477:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155486:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.155494:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156840:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156851:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156859:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393881.156900:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1785393881.156905:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393881.156925:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156936:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156944:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156950:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156955:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156960:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393881.156964:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156971:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.156991:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393881.156994:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393881.156998:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157004:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157018:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157022:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157027:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157032:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393881.157034:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157039:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157043:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44200) 00010000:00010000:1.0:1785393881.157045:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393881.157047:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157052:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157110:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157123:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.157130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785393881.157132:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393881.157135:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc152be00, rc 0) 00000100:00100000:1.0:1785393881.157220:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10425:x1872120807202944:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1964us (5617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.157227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00010000:00010000:2.0:1785393881.183760:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393881.376131:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393881.376140:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393881.376189:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1785393881.376196:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785393881.376350:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831355136:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785393881.376459:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57000 going to sleep for 11 seconds 00000100:00100000:3.0:1785393881.381791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.382431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203072 00000100:00100000:1.0:1785393881.382443:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203072 00000100:00100000:3.0:1785393881.382616:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1785393881.382630:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203072:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1785393881.382722:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203072:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 96us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393881.382730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1785393881.383502:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831355136:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785393881.385260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.385343:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203200 00000100:00100000:0.0:1785393881.385351:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203200 00000100:00100000:0.0:1785393881.385399:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1785393881.385408:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10436:x1872120807203200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785393881.385439:0:10972:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785393881.385564:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10436:x1872120807203200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 156us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.385592:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1785393881.391783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393881.391868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203328 00000100:00100000:2.0:1785393881.391880:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203328 00000100:00100000:2.0:1785393881.392814:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1785393881.392827:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10436:x1872120807203328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785393881.392933:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.392953:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.392966:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.392982:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.392989:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.392995:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393022:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393030:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393046:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393881.393090:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785393881.393095:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393881.393111:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393123:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393130:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393137:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393143:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.393147:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393155:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393168:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:2.0:1785393881.393171:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393881.393176:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393182:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b3629ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393202:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393208:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393213:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393218:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.393220:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393226:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393233:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93acc89f9f00) 00010000:00010000:2.0:1785393881.393235:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393881.393237:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393243:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b3629eff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393257:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393264:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393270:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393282:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.393285:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393302:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393312:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:2.0:1785393881.393314:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393881.393318:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.393323:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b3629f06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.393411:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10436:x1872120807203328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 586us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393881.393420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1785393881.403144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.403181:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203584 00000100:00100000:3.0:1785393881.403192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203584 00000100:00100000:3.0:1785393881.403262:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1785393881.403272:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10436:x1872120807203584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393881.403309:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393881.403354:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6b6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403486:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403502:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403526:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393881.403544:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785393881.403905:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403959:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403966:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393881.403971:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403979:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.403994:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:3.0:1785393881.403996:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785393881.404002:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.404021:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.404073:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f0d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6b6 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.404086:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:3.0:1785393881.404089:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393881.404093:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6b6 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.404103:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393881.404170:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 899us (1037us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1785393881.404177:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1785393881.409814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.409996:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203712 00000100:00100000:0.0:1785393881.410007:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203712 00000100:00100000:0.0:1785393881.410070:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1785393881.410080:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785393881.410122:0:5831:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785393881.411620:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 1535us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.411631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1785393881.416501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.417774:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807203968 00000100:00100000:1.0:1785393881.417788:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807203968 00000100:00100000:1.0:1785393881.417852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1785393881.417863:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807203968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393881.417889:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393881.417893:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785393881.417924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6a8 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.417946:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393881.417951:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393881.417985:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629f22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6bd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785393881.419233:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1785393881.419810:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.419827:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.419839:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.420074:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629f22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6bd expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.420105:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6bd expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.420114:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393881.420117:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393881.420121:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0031600, rc 0) 00000100:00100000:1.0:1785393881.420733:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10436:x1872120807203968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2868us (4240us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1785393881.420741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1785393881.434103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.434365:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204224 00000100:00100000:0.0:1785393881.434378:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204224 00000100:00100000:0.0:1785393881.434445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1785393881.434456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10436:x1872120807204224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785393881.434547:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393881.435726:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6bd expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435760:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393881.435773:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393881.435801:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435817:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435828:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435843:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435850:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435856:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435946:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435954:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393881.435971:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435987:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.435996:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393881.435998:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393881.436003:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436008:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b3629f37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436017:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436022:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436026:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436031:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393881.436033:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436038:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436043:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1bc245fa (ffff93acc7d14b00) 00010000:00010000:0.0:1785393881.436045:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393881.436047:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.436059:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b3629f3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1bc245fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393881.436157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807204224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1703us (2063us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785393881.436164:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:3.0:1785393881.454890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.456820:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204352 00000100:00100000:0.0:1785393881.456835:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204352 00000100:00100000:0.0:1785393881.456904:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1785393881.456916:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10436:x1872120807204352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393881.456944:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393881.456973:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629f45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6c4 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457017:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457033:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457048:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457157:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b3629f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 55 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457176:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 54 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.457197:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393881.457200:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785393881.457204:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393881.457288:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10436:x1872120807204352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 374us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.457295:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1785393881.468491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.468615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204608 00000100:00100000:3.0:1785393881.468628:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204608 00000100:00100000:3.0:1785393881.468693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1785393881.468704:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10436:x1872120807204608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785393881.468805:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.468823:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.468844:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785393881.469172:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1785393881.469182:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413500610887ns, next at 414500608977ns, rc = 0 00000004:00010000:3.0:1785393881.469280:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065d7ee44 reply state 000000005eca521c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.469291:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393881.469403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10436:x1872120807204608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 701us (927us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1785393881.469412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1785393881.488290:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.489438:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204736 00000100:00100000:3.0:1785393881.489451:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204736 00000100:00100000:3.0:1785393881.489541:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1785393881.489552:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10436:x1872120807204736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393881.489780:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393881.489809:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6cb expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.489883:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 57 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.489899:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 57 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.490414:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:3.0:1785393881.490435:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785393881.490440:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393881.490694:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10436:x1872120807204736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1143us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393881.490702:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:2.0:1785393881.493761:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493785:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493794:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493802:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.493808:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493834:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493854:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:2.0:1785393881.493857:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785393881.493863:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.493870:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b3629f53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.500100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.500173:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204864 00000100:00100000:0.0:1785393881.500185:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204864 00000100:00100000:0.0:1785393881.500244:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785393881.500254:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1872120807204864:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1785393881.500294:0:6631:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1785393881.500342:0:6631:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b3629f61 00002000:00100000:0.0:1785393881.500360:0:6631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93acd80ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785393881.500391:0:6631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785393881.500870:0:6631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785393881.500904:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acd80ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785393881.500984:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807204864:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 Request processed in 730us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.500992:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785393881.527715:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393881.527891:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807204992 00000100:00100000:2.0:1785393881.527912:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807204992 00000100:00100000:2.0:1785393881.527992:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785393881.528003:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:0:x1872120807204992:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1785393881.528878:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1785393881.604942:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000001:00080000:1.0:1785393881.604965:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1785393881.605106:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:0:x1872120807204992:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 77096us (77395us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1785393881.605118:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785393881.607137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.607404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807205248 00000100:00100000:1.0:1785393881.607416:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807205248 00000100:00100000:1.0:1785393881.607501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1785393881.607512:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10436:x1872120807205248:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785393881.607808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10436:x1872120807205248:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 297us (675us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1785393881.607817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1785393881.610346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.610631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807205504 00000100:00100000:0.0:1785393881.610643:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807205504 00000100:00100000:0.0:1785393881.610738:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1785393881.610755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10436:x1872120807205504:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785393881.610887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10436:x1872120807205504:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 140us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.610910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1785393881.628552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.636766:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831355264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393881.636855:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393881.638689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807205632 00000100:00100000:2.0:1785393881.638701:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807205632 00000100:00100000:2.0:1785393881.638775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1785393881.638784:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10436:x1872120807205632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785393881.638808:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393881.638832:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6d2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.639833:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831355264 00000100:00100000:3.0:1785393881.639840:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831355264 00000100:00100000:3.0:1785393881.639875:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785393881.639882:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831355264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393881.639912:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393881.640006:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831355264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393881.640012:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785393881.640169:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831355264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785393881.640999:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.641020:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.641033:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393881.641075:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393881.641095:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.641128:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b3629f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d2 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.641145:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d2 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.641154:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:2.0:1785393881.641158:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785393881.641161:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0000, rc 0) 00000100:00100000:2.0:1785393881.641219:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10436:x1872120807205632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2436us (12699us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393881.641226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1785393881.663274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.665936:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807205760 00000100:00100000:0.0:1785393881.665950:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807205760 00000100:00100000:0.0:1785393881.666011:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1785393881.666021:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807205760:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393881.666042:0:6631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393881.666067:0:6631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6d9 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393881.666100:0:6631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6af2d8, blocks: 0x1 00010000:00010000:0.0:1785393881.666121:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1785393881.666126:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393881.666137:0:6631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 6 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.666158:0:6631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 6 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.666174:0:6631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044600, rc 0) 00000100:00100000:0.0:1785393881.666277:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807205760:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 256us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.666284:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1785393881.686725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.686772:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206016 00000100:00100000:1.0:1785393881.686785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206016 00000100:00100000:1.0:1785393881.686848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1785393881.686860:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10436:x1872120807206016:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785393881.687003:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10436:x1872120807206016:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 146us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.687012:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1785393881.705670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.706653:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206144 00000100:00100000:1.0:1785393881.706666:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206144 00000100:00100000:1.0:1785393881.706731:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785393881.706743:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:10436:x1872120807206144:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393881.706768:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393881.706794:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6e0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.706834:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.706856:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.706861:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.706868:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.706922:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.706938:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.706955:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6632:1872120831355392:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393881.707060:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd80ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1785393881.712205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.712273:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6632:1872120831355392:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393881.712315:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.712340:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0030200, rc 0) 00000100:00100000:1.0:1785393881.712396:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:10436:x1872120807206144:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5655us (6735us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.712406:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785393881.712454:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206272 00000100:00100000:1.0:1785393881.712472:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206272 00010000:00010000:1.0:1785393881.712517:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.715782:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1785393881.715818:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807206272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393881.715842:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393881.715887:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.716117:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.716153:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b3629f76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d9 expref: 7 pid: 6631 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.716173:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.716179:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.716189:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.716202:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.716248:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.716280:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1872120831355520:192.168.203.12@tcp:105: 00000100:00100000:1.0:1785393881.716379:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2dfa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393881.722168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.722231:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1872120831355520:192.168.203.12@tcp:105: 00010000:00010000:1.0:1785393881.722261:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393881.722316:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807206272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6517us (10127us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.722327:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1785393881.723213:0:6637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206400 00000100:00100000:3.0:1785393881.723222:0:6637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206400 00002000:00100000:3.0:1785393881.723271:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93acff988380 x1872120807206400/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:92/0 lens 504/0 e 0 to 0 dl 1785393892 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393881.723282:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff988380 with x1872120807206400 ext(0->8) 00002000:00010000:3.0:1785393881.723286:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acff988380 00000100:00100000:3.0:1785393881.723319:0:6637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1785393881.723327:0:6637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807206400:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785393881.724510:0:6637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807206400:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1176us (2347us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1785393881.724523:0:6637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:3.0:1785393881.724680:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93acff988380 x1872120807206400/t4294967302(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:92/0 lens 504/448 e 0 to 0 dl 1785393892 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393881.724743:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff988380 with x1872120807206400 ext(0->8) 00002000:00010000:3.0:1785393881.724750:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acff988380 00000100:00100000:1.0:1785393881.728850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.728895:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206528 00000100:00100000:1.0:1785393881.729013:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206528 00000100:00100000:1.0:1785393881.729082:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1785393881.729094:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10436:x1872120807206528:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1785393881.729239:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10436:x1872120807206528:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 147us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.729247:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1785393881.736041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.736129:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206656 00000100:00100000:0.0:1785393881.736141:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206656 00000100:00100000:0.0:1785393881.736205:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1785393881.736216:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807206656:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1785393881.772434:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000001:00080000:1.0:1785393881.772474:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1785393881.772542:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1785393881.772591:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1785393881.772608:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1785393881.772617:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acd05f1480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1785393881.772622:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf76ddb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acd05f10c0 00000020:00080000:1.0:1785393881.772634:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf76dd600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acf8a3a800 00000020:00080000:1.0:1785393881.772856:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1785393881.772958:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1785393881.772979:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831355648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785393881.773050:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393881.773127:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831355648 00000100:00100000:1.0:1785393881.773134:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831355648 00000100:00100000:1.0:1785393881.773366:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785393881.773377:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831355648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785393881.773402:0:6630:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1785393881.773431:0:6630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a6af2d4, atime: 0x6a6af2d4, ctime: 0x6a6af2d4, blocks: 0x1 00010000:00010000:1.0:1785393881.773439:0:6630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.773454:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1785393881.773469:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.773475:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.773490:0:6630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.773501:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.773509:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.773534:0:6630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785393881.774077:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1872120831355648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 700us (1027us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1785393881.774085:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1785393881.774113:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393881.774119:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.774127:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393881.774131:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.774140:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.774156:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393881.774997:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393881.775021:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831355776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1785393881.775087:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1785393881.776675:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acff9aed80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1785393881.776685:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831355648:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1785393881.778251:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.778280:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393881.778283:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393881.778287:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393881.778308:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831355776 00000100:00100000:1.0:1785393881.778317:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831355776 00000100:00100000:1.0:1785393881.778380:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785393881.778388:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831355776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1785393881.778663:0:8307:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785393881.778667:0:8307:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785393880 00002000:00010000:1.0:1785393881.778670:0:8307:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785393881.778672:0:8307:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785393880 -> 1785393880 00002000:00010000:1.0:1785393881.778675:0:8307:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785393881.778759:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831355776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 370us (3670us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1785393881.778770:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:0.0:1785393881.779994:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf7ab2a00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1785393881.780007:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831355776:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1785393881.801195:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1785393881.801314:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807206656:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 65095us (65282us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.801325:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1785393881.836019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.837535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807206912 00000100:00100000:3.0:1785393881.837550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807206912 00000100:00100000:3.0:1785393881.837629:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1785393881.837640:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10436:x1872120807206912:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785393881.837691:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393881.837718:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b3629f6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6d2 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.837738:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:3.0:1785393881.837743:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393881.837771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.837785:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.837796:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785393881.838025:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea111e5e reply state 00000000a3732829 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.838035:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393881.838135:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10436:x1872120807206912:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 496us (2129us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1785393881.838153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1785393881.848801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.848838:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207040 00000100:00100000:0.0:1785393881.848847:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207040 00000100:00100000:0.0:1785393881.848892:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1785393881.848903:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807207040:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1785393881.849093:0:6632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1785393881.849097:0:6632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1785393880 -> 1785393879 00002000:00010000:0.0:1785393881.849100:0:6632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785393876 00002000:00010000:0.0:1785393881.849102:0:6632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785393880 -> 1785393879 00002000:00010000:0.0:1785393881.849104:0:6632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1785393881.849158:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807207040:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 257us (365us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1785393881.849166:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:2.0:1785393881.850242:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850271:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850278:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850284:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.850289:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850296:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850313:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:2.0:1785393881.850316:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393881.850320:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.850325:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b3629f8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.862001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.862041:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207296 00000100:00100000:3.0:1785393881.862050:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207296 00000100:00100000:3.0:1785393881.862107:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1785393881.862118:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10436:x1872120807207296:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1785393881.862182:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.862198:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 13 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.862208:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.862240:0:10972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 13 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.862254:0:10972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 13 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.862268:0:10972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831355904:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393881.862341:0:10972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81f2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785393881.865810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.865886:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207424 00000100:00100000:0.0:1785393881.865896:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207424 00010000:00010000:0.0:1785393881.865934:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393881.865978:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1785393881.865987:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807207424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393881.866000:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393881.866006:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.866019:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.866039:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393881.866044:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.866053:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.866060:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.866077:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393881.866124:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807207424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 137us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.866141:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:1.0:1785393881.866428:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b3629f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6c4 expref: 13 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.866443:0:10972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831355904:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393881.866474:0:10972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866483:0:10972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866489:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866516:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866522:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866528:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866539:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393881.866544:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866552:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866599:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:1.0:1785393881.866602:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1785393881.866606:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.866613:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b3629f92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.866875:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:10436:x1872120807207296:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 4756us (4880us total) trans 0 rc -22/-22 00000100:00100000:1.0:1785393881.866891:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1785393881.884954:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.886132:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207552 00000100:00100000:1.0:1785393881.886141:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207552 00000100:00100000:1.0:1785393881.886210:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1785393881.886220:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2361:x1872120807207552:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785393881.886257:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.886276:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.886311:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393881.886316:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393881.886321:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.886353:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.886367:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.886382:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831356032:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393881.886448:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d180 going to sleep for 11 seconds 00000100:00100000:1.0:1785393881.893085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.893115:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207680 00000100:00100000:1.0:1785393881.893122:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207680 00010000:00010000:1.0:1785393881.893157:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 8 pid: 6632 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.893247:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1785393881.893255:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807207680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393881.893268:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393881.893288:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 8 pid: 6632 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.893312:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 8 pid: 6632 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.893335:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393881.893339:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393881.893344:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.893354:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.893372:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393881.893418:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807207680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 164us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.893425:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00010000:00010000:2.0:1785393881.893744:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b3629f7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e0 expref: 7 pid: 6632 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.893766:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831356032:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393881.893793:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893805:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893828:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893865:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893874:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893883:0:8307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893890:0:8307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393881.893894:0:8307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893956:0:8307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893974:0:8307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.893981:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b3629f99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.894076:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807207552:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 7857us (9130us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393881.894086:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1785393881.902518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.902859:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807207936 00000100:00100000:1.0:1785393881.902870:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807207936 00000100:00100000:1.0:1785393881.902922:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1785393881.902931:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:10436:x1872120807207936:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785393881.902997:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903013:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903024:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903338:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903350:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 13 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903358:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903387:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 13 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.903399:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 13 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.903412:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356160:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393881.903499:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785393881.913553:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393881.913614:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208064 00000100:00100000:0.0:1785393881.913622:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208064 00010000:00010000:0.0:1785393881.913655:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393881.913686:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1785393881.913700:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2359:x1872120807208064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393881.913713:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393881.913720:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.913733:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 14 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.913765:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393881.913770:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.913780:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.913787:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.913803:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393881.913843:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2359:x1872120807208064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 144us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393881.913858:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:2.0:1785393881.915215:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b3629f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6cb expref: 13 pid: 10972 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.915241:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356160:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393881.915278:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.915289:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.915295:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393881.915545:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1785393881.915778:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1785393881.915845:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1785393881.916342:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1872120831356288:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785393881.916405:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393881.916440:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d900 going to sleep for 11 seconds 00000100:00100000:2.0:1785393881.927369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831356288 00000100:00100000:2.0:1785393881.927386:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831356288 00000100:00100000:2.0:1785393881.927479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785393881.927492:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1872120831356288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785393881.928868:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1872120831356288:12345-0@lo:1000:mdt00_000.0 Request processed in 1376us (12459us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393881.928879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785393881.928916:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1872120831356288:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1785393881.929349:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1785393881.929418:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1872120831356416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785393881.929494:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393881.929526:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393881.930021:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831356416 00000100:00100000:2.0:1785393881.930029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831356416 00000100:00100000:2.0:1785393881.930126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785393881.930135:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5831:x1872120831356416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785393881.930512:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5831:x1872120831356416:12345-0@lo:1000:mdt00_000.0 Request processed in 353us (993us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1785393881.930532:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785393881.930664:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1872120831356416:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1785393881.930701:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930712:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930719:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930725:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393881.930729:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930737:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930753:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acc7d14000) 00010000:00010000:0.0:1785393881.930756:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393881.930760:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930765:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fa7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930811:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930817:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930822:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930828:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393881.930830:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930835:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930843:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:0.0:1785393881.930845:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393881.930848:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930852:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b3629ed5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930871:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930884:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930892:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930924:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393881.930938:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 16 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393881.930949:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356544:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393881.931007:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393881.944657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393881.944694:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208192 00000100:00100000:1.0:1785393881.944705:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208192 00010000:00010000:1.0:1785393881.944752:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 17 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393881.944791:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1785393881.944801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:2359:x1872120807208192:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393881.944821:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393881.944828:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 17 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.944854:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 17 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.944880:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785393881.944897:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.944908:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.944916:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.944938:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393881.945149:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:2359:x1872120807208192:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 347us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393881.945158:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:2.0:1785393881.948142:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152be00/0xcc9b96d8b3629ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6af expref: 16 pid: 5831 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.948180:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356544:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393881.948204:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948214:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948220:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948233:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948241:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948260:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948266:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.948271:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948279:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948294:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:2.0:1785393881.948297:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393881.948301:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948307:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629fae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948319:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948325:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948330:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948335:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152ac00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393881.948337:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948353:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948362:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd8302000) 00010000:00010000:2.0:1785393881.948364:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785393881.948367:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393881.948372:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc152ac00/0xcc9b96d8b3629fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393881.948639:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10436:x1872120807207936:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 45708us (46129us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1785393881.948649:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000020:00080000:2.0:1785393881.948654:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1785393881.949114:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393881.949123:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785393881.949163:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785393881.949170:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785393881.955021:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393881.955229:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208448 00000100:00100000:3.0:1785393881.955241:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208448 00000100:00100000:3.0:1785393881.955370:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1785393881.955380:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10436:x1872120807208448:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1785393881.959468:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1785393881.959643:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1785393881.959813:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959833:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959847:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959856:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959863:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959870:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393881.959892:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785393881.959954:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1785393881.960055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:10436:x1872120807208448:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 4670us (5052us total) trans 4294967362 rc 0/0 00010000:00010000:1.0:1785393881.960064:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393881.960071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00010000:00010000:1.0:1785393881.960080:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393881.960085:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1785393881.960089:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785393881.960105:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.960130:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93acd8302100) 00010000:00010000:1.0:1785393881.960134:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785393881.960139:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.960146:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393881.960163:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393881.960166:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393881.960168:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393882.210182:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393882.309705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.309763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.309797:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.309813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.309838:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.309900:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208960 00000100:00100000:1.0:1785393882.309911:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208960 00000100:00100000:1.0:1785393882.309976:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208832 00000100:00100000:1.0:1785393882.309980:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208832 00000100:00100000:1.0:1785393882.310005:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1785393882.310016:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807208960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393882.310136:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807208960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 120us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.310144:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1785393882.310170:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1785393882.310178:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807208832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393882.310204:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807208832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.310210:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1785393882.310231:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208704 00000100:00100000:1.0:1785393882.310234:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208704 00000100:00100000:1.0:1785393882.310258:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807209088 00000100:00100000:1.0:1785393882.310261:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807209088 00000100:00100000:1.0:1785393882.310279:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:1.0:1785393882.310285:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:2358:x1872120807208704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393882.310467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1785393882.310478:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807209088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393882.310507:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807209088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393882.310520:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:3.0:1785393882.310540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807208576 00000100:00100000:3.0:1785393882.310544:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807208576 00000100:00100000:3.0:1785393882.310610:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 307 00000100:00100000:3.0:1785393882.310617:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807208576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393882.310672:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807208576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393882.310679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 307 00000100:00100000:1.0:1785393882.310874:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:2358:x1872120807208704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.311413:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00080000:1.0:1785393882.311434:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393882.311439:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1785393882.410617:0:11890:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785393882.410626:0:11890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785393882.410679:0:11890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785393882.410685:0:11890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785393882.631252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393882.633121:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807209344 00000100:00100000:3.0:1785393882.633135:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807209344 00000100:00100000:3.0:1785393882.633216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1785393882.633229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:10446:x1872120807209344:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785393882.633255:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393882.633282:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6e7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.633639:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.633656:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.633669:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393882.633683:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785393882.633885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b3629fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e7 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.633927:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e7 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.633935:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:3.0:1785393882.633938:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785393882.633942:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0800, rc 0) 00000100:00100000:3.0:1785393882.635119:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10446:x1872120807209344:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1889us (3874us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1785393882.635129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1785393882.639530:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.640054:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807209472 00000100:00100000:1.0:1785393882.640066:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807209472 00000100:00100000:1.0:1785393882.640131:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1785393882.640142:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10446:x1872120807209472:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1785393882.640238:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640258:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640272:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640311:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640319:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640327:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640693:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640703:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640711:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393882.640759:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640773:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640780:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640787:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640794:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.640798:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640814:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640828:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393882.640831:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.640836:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640842:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b3629fd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640855:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640860:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640866:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640872:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.640875:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640881:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640888:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44300) 00010000:00010000:1.0:1785393882.640891:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.640893:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640910:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b3629fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640928:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640934:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640940:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640945:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.640949:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.640955:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.641117:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44b00) 00010000:00010000:1.0:1785393882.641120:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.641124:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.641130:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030200/0xcc9b96d8b3629fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393882.641253:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10446:x1872120807209472:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1111us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.641262:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1785393882.706855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393882.707052:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807209728 00000100:00100000:0.0:1785393882.707065:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807209728 00000100:00100000:0.0:1785393882.707136:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1785393882.707147:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10449:x1872120807209728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393882.707177:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393882.707205:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6ee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707309:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707464:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707482:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707501:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707523:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.707530:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708471:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708483:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708492:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393882.708504:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1785393882.708648:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708657:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708664:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708671:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393882.708677:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708686:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708713:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393882.708716:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393882.708721:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708729:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b3629fed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708742:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708749:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708755:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708761:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393882.708764:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708770:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708779:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acd96a4600) 00010000:00010000:0.0:1785393882.708782:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393882.708785:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708791:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b3629ff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b3629fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.708872:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.720538:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:0.0:1785393882.720543:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393882.720548:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044c00, rc 0) 00000100:00100000:0.0:1785393882.720659:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10449:x1872120807209728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 13507us (13812us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1785393882.720670:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1785393882.736955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393882.737176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807209856 00000100:00100000:3.0:1785393882.737188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807209856 00000100:00100000:3.0:1785393882.737252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:3.0:1785393882.737264:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10449:x1872120807209856:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1785393882.739120:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739145:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739160:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739195:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739202:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739217:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739224:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393882.739230:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739239:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739253:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:3.0:1785393882.739256:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393882.739262:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393882.739269:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393882.739357:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10449:x1872120807209856:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 2093us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393882.739366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1785393882.746474:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393882.746510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807210112 00000100:00100000:2.0:1785393882.746521:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807210112 00000100:00100000:2.0:1785393882.746594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1785393882.746606:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd042c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10449:x1872120807210112:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393882.747841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd042c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:10449:x1872120807210112:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 275us (426us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1785393882.747852:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000001:00080000:1.0:1785393882.756486:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1785393882.756517:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1785393882.778133:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393882.778276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807210368 00000100:00100000:2.0:1785393882.778288:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807210368 00000100:00100000:2.0:1785393882.778362:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1785393882.778375:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:9977:x1872120807210368:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393882.778409:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393882.778436:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a010 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6f5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393882.778612:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393882.778630:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393882.778641:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393882.778684:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393882.778699:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 23 pid: 5832 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393882.778715:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831356672:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393882.778820:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785393882.782347:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad007b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831356672:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393882.782384:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393882.782534:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.783214:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807210496 00000100:00100000:1.0:1785393882.783223:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807210496 00010000:00010000:1.0:1785393882.783263:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 24 pid: 5832 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393882.783323:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1785393882.783334:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:2358:x1872120807210496:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393882.783350:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393882.783358:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 24 pid: 5832 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783372:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 24 pid: 5832 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783396:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b3629ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6ee expref: 24 pid: 5832 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783411:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393882.783416:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783445:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783462:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.783489:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393882.792025:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:2358:x1872120807210496:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 8678us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.792044:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00010000:00010000:1.0:1785393882.792240:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.792253:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393882.792281:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1785393882.792504:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a010 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.792526:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.792537:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393882.792540:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785393882.792545:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:1.0:1785393882.792651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:9977:x1872120807210368:12345-192.168.203.12@tcp:101:bash.0 Request processed in 14279us (14530us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1785393882.792677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1785393882.798700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393882.798853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807210752 00000100:00100000:0.0:1785393882.798866:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807210752 00000100:00100000:0.0:1785393882.798944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1785393882.798957:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:9977:x1872120807210752:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1785393882.799465:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.799486:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.799500:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393882.799606:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1785393882.799635:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007eae1f93 reply state 0000000019b2240b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393882.799645:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1785393882.799696:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1785393882.799815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:9977:x1872120807210752:12345-192.168.203.12@tcp:36:bash.0 Request processed in 859us (1127us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1785393882.799823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000020:00080000:0.0:1785393882.799829:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1785393882.802998:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803016:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803025:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803031:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393882.803037:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803144:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803164:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:0.0:1785393882.803167:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393882.803173:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.803199:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a025 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393882.808058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393882.808140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807210880 00000100:00100000:0.0:1785393882.808153:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807210880 00000100:00100000:0.0:1785393882.808223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1785393882.808236:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:9977:x1872120807210880:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1785393882.808269:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393882.808299:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a02c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd6fc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.808377:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a02c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6fc expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.808396:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a02c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6fc expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393882.808418:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:0.0:1785393882.808422:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393882.808426:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045e00, rc 0) 00000100:00100000:0.0:1785393882.808516:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:9977:x1872120807210880:12345-192.168.203.12@tcp:101:bash.0 Request processed in 283us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393882.808524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1785393882.814352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.817494:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211008 00000100:00100000:1.0:1785393882.817512:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211008 00000100:00100000:1.0:1785393882.817616:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1785393882.817628:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:9977:x1872120807211008:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393882.817653:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393882.817681:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd703 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785393882.817714:0:6632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a6af2d7, atime: 0x6a6af2d4, ctime: 0x6a6af2d7, blocks: 0xb 00010000:00010000:1.0:1785393882.817743:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1785393882.817748:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393882.817758:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.817778:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.817792:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc0030200, rc 0) 00000100:00100000:1.0:1785393882.817875:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:9977:x1872120807211008:12345-192.168.203.12@tcp:101:bash.0 Request processed in 250us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.817890:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1785393882.825689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393882.825828:0:6635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211136 00000100:00100000:0.0:1785393882.825840:0:6635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211136 00002000:00010000:0.0:1785393882.825900:0:6635:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1785393882.825906:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf76a2a00 with x1872120807211136 ext(0->18446744073709551615) 00002000:00010000:0.0:1785393882.825929:0:6635:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf76a2a00. 00000100:00100000:3.0:1785393882.826163:0:6637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1785393882.826178:0:6637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807211136:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:3.0:1785393882.826549:0:6637:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1785393882.826554:0:6637:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1785393879 -> 1785393881 00002000:00010000:3.0:1785393882.826557:0:6637:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1785393876 -> 1785393876 00002000:00010000:3.0:1785393882.826559:0:6637:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1785393879 -> 1785393881 00002000:00010000:3.0:1785393882.826601:0:6637:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1785393882.826682:0:6637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807211136:12345-192.168.203.12@tcp:10:bash.0 Request processed in 507us (1006us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1785393882.826691:0:6637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:3.0:1785393882.826695:0:6637:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1785393882.826697:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf76a2a00 with x1872120807211136 ext(0->18446744073709551615) 00002000:00010000:3.0:1785393882.826702:0:6637:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf76a2a00. 00000100:00100000:3.0:1785393882.951887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393882.955163:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211264 00000100:00100000:1.0:1785393882.955183:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211264 00000100:00100000:1.0:1785393882.955267:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1785393882.955279:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:10464:x1872120807211264:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1785393882.955794:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.955815:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.955829:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.955847:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.955854:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.955859:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956449:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956469:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956477:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393882.956528:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956549:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956556:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956562:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956590:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.956605:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956614:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956629:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393882.956633:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.956638:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956644:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0031600/0xcc9b96d8b362a03a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956660:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956666:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956672:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956684:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.956687:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956694:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956702:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44a00) 00010000:00010000:1.0:1785393882.956704:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.956707:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956713:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc0030600/0xcc9b96d8b362a041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956731:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956737:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956742:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956747:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393882.956749:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956755:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956773:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393882.956775:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393882.956779:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393882.956785:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393882.956886:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:10464:x1872120807211264:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1607us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393882.956895:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1785393883.060373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.060672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211520 00000100:00100000:1.0:1785393883.060685:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211520 00000100:00100000:1.0:1785393883.060761:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1785393883.060773:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:10467:x1872120807211520:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393883.060801:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393883.060828:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a04f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd70a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.060925:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.060942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.060956:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.060972:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.060997:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.061003:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063681:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063720:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393883.063732:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1785393883.063851:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063859:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063867:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063873:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bae00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.063878:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063886:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063917:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393883.063920:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393883.063925:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063933:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063949:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063955:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063965:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.063968:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063974:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063982:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44a00) 00010000:00010000:1.0:1785393883.063984:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393883.063987:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.063993:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.064518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a04f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd70a expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.064536:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd70a expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.064545:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393883.064547:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785393883.064550:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb600, rc 0) 00000100:00100000:1.0:1785393883.064676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad007b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10467:x1872120807211520:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 3903us (4314us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1785393883.064685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:0.0:1785393883.069499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393883.069611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211648 00000100:00100000:3.0:1785393883.069623:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211648 00000100:00100000:3.0:1785393883.069690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1785393883.069701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10467:x1872120807211648:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1785393883.069793:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.069813:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.069824:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.069867:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.069883:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 29 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393883.069900:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356800:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393883.070027:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2dfacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393883.079980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393883.080242:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831356800:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393883.080280:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.084792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807211904 00000100:00100000:0.0:1785393883.084812:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807211904 00000100:00100000:0.0:1785393883.084899:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1785393883.084911:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:5580:x1872120807211904:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785393883.087266:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:5580:x1872120807211904:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 2347us (7291us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1785393883.087278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1785393883.102936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.103080:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807212032 00000100:00100000:1.0:1785393883.103092:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807212032 00010000:00010000:1.0:1785393883.103141:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 31 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.103192:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:1.0:1785393883.103201:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:2359:x1872120807212032:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393883.103218:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393883.103225:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 31 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103239:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 31 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103387:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a017 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6f5 expref: 31 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103409:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393883.103415:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103426:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103434:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.103522:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393883.103638:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:2359:x1872120807212032:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 436us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.103646:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:3.0:1785393883.107767:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107787:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107828:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107836:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107844:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107850:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393883.107855:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107862:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107879:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:3.0:1785393883.107882:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393883.107886:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.107917:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393883.108550:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10467:x1872120807211648:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 38843us (39056us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393883.108562:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1785393883.122466:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.122642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807212288 00000100:00100000:1.0:1785393883.122655:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807212288 00000100:00100000:1.0:1785393883.122721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1785393883.122733:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:10467:x1872120807212288:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393883.123030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:10467:x1872120807212288:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 297us (584us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1785393883.123382:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:1.0:1785393883.231803:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393883.277760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.280535:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807212544 00000100:00100000:0.0:1785393883.280554:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807212544 00000100:00100000:0.0:1785393883.280664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1785393883.280676:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:10478:x1872120807212544:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1785393883.280710:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393883.280738:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd711 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280830:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280862:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280879:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.280929:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284636:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a08e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284658:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a08e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284671:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a08e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393883.284685:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1785393883.284807:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284816:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284824:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284831:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393883.284836:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284844:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284871:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393883.284875:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393883.284880:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284887:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284903:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284910:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284916:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284922:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393883.284925:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284931:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284939:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acd96a4600) 00010000:00010000:0.0:1785393883.284942:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393883.284945:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.284950:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.287227:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd711 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.287300:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a08e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd711 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.287311:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:0.0:1785393883.287313:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393883.287317:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045800, rc 0) 00000100:00100000:0.0:1785393883.287410:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10478:x1872120807212544:12345-192.168.203.12@tcp:101:cat.0 Request processed in 6735us (9661us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1785393883.287421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1785393883.294698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.295653:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807212800 00000100:00100000:0.0:1785393883.295666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807212800 00000100:00100000:0.0:1785393883.295727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785393883.295739:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10478:x1872120807212800:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1785393883.296060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:10478:x1872120807212800:12345-192.168.203.12@tcp:35:cat.0 Request processed in 322us (1374us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1785393883.296069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1785393883.365000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.365248:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213056 00000100:00100000:1.0:1785393883.365277:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213056 00000100:00100000:1.0:1785393883.365359:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1785393883.365371:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:10479:x1872120807213056:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1785393883.365468:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785393883.365503:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a08e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd711 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365537:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd70a expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365551:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a02c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6fc expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365561:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:1.0:1785393883.365631:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393883.365659:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365675:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365686:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365702:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365709:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.365727:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.366527:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.366538:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.366548:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785393883.372082:0:10972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1785393883.372098:0:10972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415403527229ns, next at 416403523652ns, rc = 0 00010000:00010000:1.0:1785393883.372185:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372207:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372221:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372231:0:10972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372237:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372244:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372281:0:10972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785393883.372312:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372319:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372326:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372332:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bae00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.372337:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372345:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372359:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44800) 00010000:00010000:1.0:1785393883.372362:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785393883.372368:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372374:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372395:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372402:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372420:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372425:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.372428:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372434:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372442:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393883.372445:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393883.372459:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.372466:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a09c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393883.372478:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c8da146 reply state 000000006450d612 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.372489:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393883.372638:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:10479:x1872120807213056:12345-192.168.203.12@tcp:36:rm.0 Request processed in 7263us (7646us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1785393883.372647:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00010000:00010000:2.0:1785393883.374344:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393883.374357:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.374384:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393883.374389:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.374398:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.374415:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93acc3c44800) 00010000:00010000:2.0:1785393883.374418:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785393883.374422:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.374427:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a0b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.374460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393883.374462:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393883.374464:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393883.383026:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383058:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383089:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383096:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.383102:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383110:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383130:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44a00) 00010000:00010000:1.0:1785393883.383133:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393883.383138:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.383145:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393883.448137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.457634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213312 00000100:00100000:1.0:1785393883.457652:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213312 00000100:00100000:1.0:1785393883.457726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1785393883.457736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:10485:x1872120807213312:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393883.457769:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393883.457938:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458222:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458235:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458252:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458259:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.458266:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785393883.459564:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1785393883.460101:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460116:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460125:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460171:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460181:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460188:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460205:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393883.460210:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460218:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460232:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393883.460235:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393883.460241:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.460247:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393883.460262:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083eea5b9 reply state 0000000037c43cf6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.460272:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785393883.460321:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a0b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.461905:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.461915:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393883.461918:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393883.461921:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb600, rc 0) 00000100:00100000:1.0:1785393883.462135:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:10485:x1872120807213312:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4398us (14010us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1785393883.462158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1785393883.474078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:0.0:1785393883.474729:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474745:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474754:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474790:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bae00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393883.474796:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474805:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474825:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44a00) 00010000:00010000:0.0:1785393883.474829:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393883.474834:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.474841:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a0c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393883.475525:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213440 00000100:00100000:3.0:1785393883.475540:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213440 00000100:00100000:3.0:1785393883.475626:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1785393883.475639:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807213440:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393883.475661:0:6631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393883.475684:0:6631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd71f expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785393883.475717:0:6631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785393883.475742:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1785393883.475748:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393883.475759:0:6631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 6 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.475780:0:6631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 6 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.475795:0:6631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1a00, rc 0) 00000100:00100000:3.0:1785393883.475874:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807213440:12345-192.168.203.12@tcp:101:bash.0 Request processed in 238us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393883.475893:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1785393883.482385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.482501:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213568 00000100:00100000:1.0:1785393883.482514:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213568 00000100:00100000:1.0:1785393883.482607:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1785393883.482620:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:10485:x1872120807213568:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393883.482646:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393883.482668:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd726 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.482708:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 7 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.482718:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393883.482723:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393883.482729:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.482771:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 7 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.482799:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 7 pid: 6631 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.482816:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831356928:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393883.482945:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393883.501315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.501733:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213696 00000100:00100000:0.0:1785393883.501747:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213696 00010000:00010000:0.0:1785393883.501802:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 8 pid: 6631 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.501859:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1785393883.501870:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807213696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393883.501888:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393883.501928:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 8 pid: 6631 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.501969:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 8 pid: 6631 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.502001:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393883.502008:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393883.502018:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.502041:0:6645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.502089:0:6645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.502107:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831357056:192.168.203.12@tcp:105: 00000100:00100000:0.0:1785393883.502211:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1785393883.502773:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a0db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd71f expref: 8 pid: 6631 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.502794:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831356928:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393883.502834:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.502847:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba600, rc 0) 00000100:00100000:1.0:1785393883.502879:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:10485:x1872120807213568:12345-192.168.203.12@tcp:101:bash.0 Request processed in 20262us (20516us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.502888:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1785393883.509714:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831357056:192.168.203.12@tcp:105: 00010000:00010000:0.0:1785393883.509750:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393883.509821:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807213696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 7950us (8519us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393883.509832:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1785393883.509965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.510053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807213952 00000100:00100000:0.0:1785393883.510062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807213952 00000100:00100000:0.0:1785393883.510105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1785393883.510113:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:10485:x1872120807213952:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1785393883.510709:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:10485:x1872120807213952:12345-192.168.203.12@tcp:35:bash.0 Request processed in 595us (744us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1785393883.510717:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1785393883.801855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.801958:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214080 00000100:00100000:1.0:1785393883.801971:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214080 00000100:00100000:1.0:1785393883.802045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1785393883.802056:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:10501:x1872120807214080:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393883.802085:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393883.802110:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd72d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802188:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802204:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802215:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393883.802329:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1785393883.802333:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393883.802361:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802392:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a0e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd72d expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802413:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd72d expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.802423:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393883.802426:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393883.802430:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bbc00, rc 0) 00000100:00100000:1.0:1785393883.802506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10501:x1872120807214080:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 453us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.802513:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1785393883.823315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.823423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214336 00000100:00100000:0.0:1785393883.823435:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214336 00000100:00100000:0.0:1785393883.823515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1785393883.823528:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:10501:x1872120807214336:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393883.823556:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393883.823626:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a0f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd734 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.823757:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a0fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.823786:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.823802:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393883.823816:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1785393883.823977:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a0f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd734 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.824001:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a0fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd734 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.824011:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393883.824032:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393883.824037:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045200, rc 0) 00000100:00100000:0.0:1785393883.824111:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:10501:x1872120807214336:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 585us (810us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1785393883.824119:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1785393883.828787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.829028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214592 00000100:00100000:1.0:1785393883.829042:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214592 00000100:00100000:1.0:1785393883.829113:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1785393883.829127:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:10501:x1872120807214592:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393883.829161:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393883.829188:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a10c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd73b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.829315:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.829358:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.829372:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393883.829393:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785393883.829558:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a10c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd73b expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.829767:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd73b expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.829834:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393883.829838:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785393883.829841:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba200, rc 0) 00000100:00100000:1.0:1785393883.829907:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:10501:x1872120807214592:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 782us (1148us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1785393883.829915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1785393883.833996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.837041:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214720 00000100:00100000:1.0:1785393883.837058:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214720 00000100:00100000:1.0:1785393883.837154:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785393883.837166:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:2361:x1872120807214720:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393883.837188:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393883.837222:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a0fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd734 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.837268:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393883.837284:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393883.837372:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:2361:x1872120807214720:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 208us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.837380:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785393883.840765:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393883.842328:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214848 00000100:00100000:3.0:1785393883.842343:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214848 00000100:00100000:3.0:1785393883.842414:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1785393883.842426:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807214848:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1785393883.842490:0:6631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.842514:0:6631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.842524:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393883.842528:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393883.842534:0:6631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.842606:0:6631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393883.842622:0:6631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 6 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393883.842639:0:6631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6631:1872120831357184:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393883.842756:0:6631:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2dfacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393883.845207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.845286:0:6636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807214976 00000100:00100000:0.0:1785393883.845294:0:6636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807214976 00002000:00100000:0.0:1785393883.845346:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93acf7eb8000 x1872120807214976/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:94/0 lens 504/0 e 0 to 0 dl 1785393894 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393883.845357:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7eb8000 with x1872120807214976 ext(0->8) 00010000:00010000:0.0:1785393883.845366:0:6636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 7 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.845380:0:6636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 7 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393883.845388:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acf7eb8000 00000100:00100000:0.0:1785393883.845419:0:6636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785393883.845429:0:6636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807214976:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:1.0:1785393883.845671:0:6631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6631:1872120831357184:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393883.845700:0:6631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.847043:0:6636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2360:x1872120807214976:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1606us (1833us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1785393883.847057:0:6636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00100000:0.0:1785393883.847067:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93acf7eb8000 x1872120807214976/t4294967302(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:94/0 lens 504/448 e 0 to 0 dl 1785393894 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393883.847077:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7eb8000 with x1872120807214976 ext(0->8) 00010000:00010000:0.0:1785393883.847094:0:6636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.847111:0:6636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393883.847119:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acf7eb8000 00000100:00100000:0.0:1785393883.850538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393883.850737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807215104 00000100:00100000:2.0:1785393883.850757:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807215104 00010000:00010000:2.0:1785393883.850795:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393883.850841:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1785393883.850850:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2361:x1872120807215104:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393883.850864:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785393883.850881:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785393883.850884:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785393882 00002000:00010000:2.0:1785393883.850886:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785393882 00002000:00010000:2.0:1785393883.850888:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785393882 00010000:00010000:2.0:1785393883.850894:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.850916:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.850936:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d154c6/0xcc9b96d8b362a0e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd726 expref: 9 pid: 6632 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.850951:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393883.850955:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393883.850961:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.850970:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393883.851011:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393883.851049:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2361:x1872120807215104:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 200us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393883.851056:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00010000:00010000:1.0:1785393883.851297:0:6631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851308:0:6631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851331:0:6631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851339:0:6631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851346:0:6631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851364:0:6631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393883.851369:0:6631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851378:0:6631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851391:0:6631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.851399:0:6631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b164a16a/0xcc9b96d8b362a121 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.851465:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807214848:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 9042us (10711us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.851480:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1785393883.864391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.864481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807215360 00000100:00100000:0.0:1785393883.864492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807215360 00000100:00100000:0.0:1785393883.864544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1785393883.864553:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd041850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:10501:x1872120807215360:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1785393883.864650:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd73b expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393883.864878:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1785393883.864917:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1785393883.865184:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1785393883.865232:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.865246:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.865255:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.865286:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.865318:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 42 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.865333:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831357312:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393883.865408:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63480 going to sleep for 11 seconds 00000100:00100000:3.0:1785393883.873697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.873800:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807215488 00000100:00100000:1.0:1785393883.873808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807215488 00010000:00010000:1.0:1785393883.873844:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 43 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393883.873881:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1785393883.873890:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:2359:x1872120807215488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393883.873910:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393883.873917:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 43 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.873941:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 43 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.873961:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393883.873966:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.873975:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.873982:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393883.873998:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393883.874047:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:2359:x1872120807215488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393883.874055:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00010000:00010000:0.0:1785393883.874157:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd718 expref: 42 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.874171:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831357312:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393883.874188:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.874196:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.874201:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393883.874310:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1785393883.874515:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1785393883.874875:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831357440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785393883.874915:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393883.877551:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd824b000 going to sleep for 11 seconds 00000100:00100000:1.0:1785393883.887062:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831357440 00000100:00100000:1.0:1785393883.887075:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831357440 00000100:00100000:2.0:1785393883.887242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785393883.887254:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831357440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393883.887372:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831357440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (12455us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393883.887380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1785393883.887825:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785393883.889015:0:5834:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1785393883.889022:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1785393883.889040:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acff9aed80, transno 4294967301 00000100:00100000:0.0:1785393883.889065:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831357440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1785393883.889650:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1785393883.889728:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831357568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785393883.889778:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393883.889804:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad005e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785393883.890501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831357568 00000100:00100000:2.0:1785393883.890509:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831357568 00000100:00100000:2.0:1785393883.890554:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785393883.890562:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831357568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393883.890890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1872120831357568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 328us (1111us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1785393883.890897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785393883.890976:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831357568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1785393883.891025:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1785393883.891062:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891073:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891081:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891087:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393883.891092:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891099:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891114:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393883.891117:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1785393883.891121:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.891126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a128 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785393883.891278:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1785393883.891353:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1785393883.891363:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415922792061ns, next at 416922790085ns, rc = 0 00000001:00080000:0.0:1785393883.891369:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1785393883.891399:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393883.891402:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785393883.891409:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd73b expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393883.891559:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd041850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+45:10501:x1872120807215360:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 27007us (27176us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1785393883.891815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000020:00080000:0.0:1785393883.891822:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785393883.894862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393883.895592:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807215616 00000100:00100000:0.0:1785393883.895600:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807215616 00000100:00100000:0.0:1785393883.895738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1785393883.895748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+45:10501:x1872120807215616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393883.895768:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393883.895791:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a12f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd742 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.895840:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd742 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.895853:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd742 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393883.895886:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393883.895889:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393883.895892:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045200, rc 0) 00000100:00100000:0.0:1785393883.895980:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:10501:x1872120807215616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 233us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393883.895986:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1785393883.907303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393883.907378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807215872 00000100:00100000:1.0:1785393883.907387:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807215872 00000100:00100000:1.0:1785393883.907438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785393883.907458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+46:10501:x1872120807215872:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393883.907712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10501:x1872120807215872:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 264us (416us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1785393883.907720:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1785393884.066847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.066970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807216000 00000100:00100000:1.0:1785393884.066982:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807216000 00000100:00100000:1.0:1785393884.067059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1785393884.067072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10511:x1872120807216000:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1785393884.067167:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067185:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067200:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067217:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067224:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067230:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785393884.067352:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785393884.067544:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067554:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067598:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393884.067761:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067843:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067850:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067857:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067864:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.067869:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067876:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067890:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393884.067893:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.067898:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067918:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067924:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067930:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067940:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.067943:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067949:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067957:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44d00) 00010000:00010000:1.0:1785393884.067960:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.067963:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067970:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a13d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067984:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067991:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.067998:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.068003:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.068006:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.068012:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.068031:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.068033:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.068037:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.068043:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.068127:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10511:x1872120807216000:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1057us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.068134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:3.0:1785393884.150910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393884.151117:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807216256 00000100:00100000:0.0:1785393884.151129:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807216256 00000100:00100000:0.0:1785393884.151197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:0.0:1785393884.151208:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+47:10514:x1872120807216256:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393884.151233:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393884.151259:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a14b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd749 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151365:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151382:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151395:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151413:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151454:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151900:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151910:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.151978:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393884.151990:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1785393884.152103:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152111:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152118:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152124:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393884.152128:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152137:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152150:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393884.152153:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393884.152166:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152173:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152189:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152195:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152201:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152205:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393884.152208:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152214:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152221:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acd96a4e00) 00010000:00010000:0.0:1785393884.152224:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393884.152226:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152232:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152273:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a14b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152298:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.152307:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393884.152309:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393884.152311:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045c00, rc 0) 00000100:00100000:0.0:1785393884.153957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:10514:x1872120807216256:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2745us (3054us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1785393884.153969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:2.0:1785393884.164627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.164764:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807216384 00000100:00100000:1.0:1785393884.164783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807216384 00000100:00100000:1.0:1785393884.164851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1785393884.164862:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:10514:x1872120807216384:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1785393884.164968:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.164988:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165001:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165034:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165040:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165067:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165073:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.165078:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165085:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165098:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.165101:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393884.165105:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.165111:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a16e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.165204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:10514:x1872120807216384:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 344us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.165213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:3.0:1785393884.168638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.168894:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807216640 00000100:00100000:1.0:1785393884.168908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807216640 00000100:00100000:1.0:1785393884.168972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1785393884.168984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+49:10514:x1872120807216640:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785393884.169260:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10514:x1872120807216640:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 278us (634us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1785393884.169269:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:1.0:1785393884.256566:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393884.260205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.260305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807216896 00000100:00100000:1.0:1785393884.260317:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807216896 00000100:00100000:1.0:1785393884.260389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1785393884.260400:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10524:x1872120807216896:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393884.260432:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393884.260435:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785393884.260476:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a0f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd72d expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.260499:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393884.260504:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393884.260521:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a175 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd750 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.261153:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.261170:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.261179:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.261216:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.261232:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 50 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.261260:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831357696:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393884.261465:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393884.265545:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831357696:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393884.265741:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.266753:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393884.266880:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217024 00000100:00100000:3.0:1785393884.266889:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217024 00010000:00010000:3.0:1785393884.266941:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 51 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393884.266983:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1785393884.266992:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:2358:x1872120807217024:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393884.267008:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393884.267014:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 51 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267027:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 51 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267051:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd749 expref: 51 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267070:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:3.0:1785393884.267076:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267103:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267113:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.267147:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393884.267207:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:2358:x1872120807217024:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 215us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393884.267215:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00010000:00010000:1.0:1785393884.267854:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.267863:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393884.267884:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785393884.268073:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a175 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.268090:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.268098:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.268101:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785393884.268103:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb200, rc 0) 00000100:00100000:1.0:1785393884.268138:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10524:x1872120807216896:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7739us (7946us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1785393884.268146:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1785393884.271254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.272092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217280 00000100:00100000:1.0:1785393884.272103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217280 00000100:00100000:1.0:1785393884.272164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:1.0:1785393884.272174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:10524:x1872120807217280:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1785393884.272502:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.272520:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.272532:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785393884.273089:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1785393884.273118:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c590004 reply state 0000000027b1325c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.273128:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393884.273242:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10524:x1872120807217280:12345-192.168.203.12@tcp:36:bash.0 Request processed in 1068us (1997us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1785393884.273250:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000020:00080000:1.0:1785393884.273255:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785393884.276981:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277001:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277008:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277015:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.277038:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277047:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277065:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.277069:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.277074:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.277082:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a18a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393884.277296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393884.277810:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217408 00000100:00100000:3.0:1785393884.277823:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217408 00000100:00100000:3.0:1785393884.277877:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:3.0:1785393884.277887:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10524:x1872120807217408:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393884.277912:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393884.277930:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd757 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.278021:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.278037:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.278045:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.278083:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393884.278108:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 53 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393884.278125:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831357824:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393884.278218:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2dfacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785393884.282476:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc7acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831357824:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393884.282513:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393884.286369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.286809:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217536 00000100:00100000:1.0:1785393884.286820:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217536 00010000:00010000:1.0:1785393884.286876:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 54 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.286923:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1785393884.286934:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:2359:x1872120807217536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393884.286950:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393884.286958:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 54 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.286971:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 54 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.286996:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a17c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd750 expref: 54 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.287035:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.287041:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.287052:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.287060:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.287084:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393884.287157:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:2359:x1872120807217536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 223us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.287165:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:0.0:1785393884.288757:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.288777:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393884.288836:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1785393884.288842:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393884.288868:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.288904:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.288941:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393884.288950:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393884.288953:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393884.288956:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1000, rc 0) 00000100:00100000:0.0:1785393884.289003:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10524:x1872120807217408:12345-192.168.203.12@tcp:101:bash.0 Request processed in 11118us (11713us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393884.289010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1785393884.292781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393884.292900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217792 00000100:00100000:2.0:1785393884.292920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217792 00000100:00100000:2.0:1785393884.292971:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1785393884.292981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:10524:x1872120807217792:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1785393884.293242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10524:x1872120807217792:12345-192.168.203.12@tcp:35:bash.0 Request processed in 254us (472us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1785393884.293264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1785393884.363389:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.363501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807217920 00000100:00100000:1.0:1785393884.363514:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807217920 00000100:00100000:1.0:1785393884.363700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:1.0:1785393884.363713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+53:10530:x1872120807217920:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393884.363745:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393884.363833:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a19f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd75e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.363969:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.363986:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.363999:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393884.364087:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1785393884.364091:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393884.364113:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.364141:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a19f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd75e expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.364160:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd75e expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.364171:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393884.364174:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393884.364178:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb800, rc 0) 00000100:00100000:1.0:1785393884.364236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807217920:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 526us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.364245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:3.0:1785393884.370914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.371015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218048 00000100:00100000:1.0:1785393884.371029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218048 00000100:00100000:1.0:1785393884.371151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1785393884.371164:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807218048:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393884.371191:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393884.371218:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd765 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371309:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371346:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371359:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371377:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.371392:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372087:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372098:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372107:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393884.372151:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1785393884.372156:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393884.372180:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372194:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372216:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372224:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372231:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372237:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.372243:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372250:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372265:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393884.372268:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.372273:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372280:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372293:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372300:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372306:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372319:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbc00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393884.372322:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372329:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372339:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acc3c44d00) 00010000:00010000:1.0:1785393884.372342:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393884.372345:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372351:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372387:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372402:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.372410:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.372412:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393884.372415:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bba00, rc 0) 00000100:00100000:1.0:1785393884.375364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10530:x1872120807218048:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4188us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.375378:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1785393884.388564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.388948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218304 00000100:00100000:1.0:1785393884.388979:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218304 00000100:00100000:1.0:1785393884.389159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1785393884.389172:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10530:x1872120807218304:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393884.389201:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393884.389227:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd76c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389371:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389390:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389400:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389409:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389458:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389474:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.389501:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831357952:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393884.389669:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.389704:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.389715:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831358080:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393884.389753:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393884.397922:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393884.398126:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218432 00000100:00100000:2.0:1785393884.398139:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218432 00010000:00010000:2.0:1785393884.398190:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 57 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393884.398238:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:2.0:1785393884.398249:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:2359:x1872120807218432:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393884.398268:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393884.398287:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 57 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.398302:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 57 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.398863:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:2.0:1785393884.398871:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.398881:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.398888:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393884.398959:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:2359:x1872120807218432:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 710us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393884.398967:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00010000:00010000:1.0:1785393884.400209:0:5831:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.12@tcp) returned -22 from blocking AST (req@00000000d43accb3 x1872120831357952) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.400229:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd765 expref: 56 pid: 5833 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.400246:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831357952:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393884.400388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393884.400554:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218560 00000100:00100000:2.0:1785393884.400610:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218560 00010000:00010000:2.0:1785393884.400642:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393884.400680:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1785393884.400698:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:2359:x1872120807218560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393884.400713:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393884.400887:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.400903:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 56 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.400923:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:2.0:1785393884.400928:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.400937:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.400946:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.400969:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393884.401089:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:2359:x1872120807218560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 400us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393884.401098:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:1.0:1785393884.401647:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd757 expref: 55 pid: 5832 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393884.401662:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831358080:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393884.401682:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.401689:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.401829:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.401835:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393884.401869:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785393884.402110:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.402127:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.402134:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.402136:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785393884.402139:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bbc00, rc 0) 00000100:00100000:1.0:1785393884.402170:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10530:x1872120807218304:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 13003us (13670us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1785393884.402178:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1785393884.414283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393884.414439:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218816 00000100:00100000:3.0:1785393884.414460:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218816 00000100:00100000:3.0:1785393884.414686:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1785393884.414713:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10530:x1872120807218816:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:2.0:1785393884.415183:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393884.415217:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a12f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd742 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.415258:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:2.0:1785393884.415264:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393884.415340:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807218816:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 631us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393884.415349:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1785393884.429340:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393884.429460:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807218944 00000100:00100000:3.0:1785393884.429473:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807218944 00000100:00100000:3.0:1785393884.429552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1785393884.429563:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807218944:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1785393884.430115:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.430137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393884.430152:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785393884.430414:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1785393884.430534:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807218944:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 971us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393884.430543:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:3.0:1785393884.446887:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393884.447028:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219072 00000100:00100000:1.0:1785393884.447041:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219072 00000100:00100000:1.0:1785393884.447113:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:1.0:1785393884.447126:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:10530:x1872120807219072:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393884.447153:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393884.447180:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd773 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.447930:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.447946:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 55 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.447991:0:10972:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.448008:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 55 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.448025:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393884.448029:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393884.448033:0:10972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 55 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393884.448042:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb200, rc 0) 00000100:00100000:1.0:1785393884.448110:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10530:x1872120807219072:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 987us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393884.448118:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000040:00080000:1.0:1785393885.025810:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393885.025822:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785393885.025898:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1785393885.025905:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785393885.026063:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831358208:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785393885.026191:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393885.032157:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831358208:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785393885.034958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.039506:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219200 00000100:00100000:1.0:1785393885.039525:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219200 00000100:00100000:1.0:1785393885.051853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1785393885.052496:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10531:x1872120807219200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785393885.052562:0:5833:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785393885.052832:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10531:x1872120807219200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 962us (17884us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.052841:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1785393885.061967:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.062902:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219328 00000100:00100000:1.0:1785393885.062915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219328 00000100:00100000:1.0:1785393885.063000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:1.0:1785393885.063013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10531:x1872120807219328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.063108:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.063127:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.063142:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064369:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064386:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064396:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064450:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393885.064528:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1785393885.064533:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393885.064561:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064588:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064596:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064604:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064611:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bba00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.064616:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064624:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064639:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:1.0:1785393885.064642:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393885.064647:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064654:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a1ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064680:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064686:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064692:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064698:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.064701:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064707:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064716:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.064718:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393885.064721:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a1f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064744:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064750:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064756:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064769:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bac00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.064772:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064778:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064798:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393885.064801:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393885.064804:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.064810:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a1fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.064908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10531:x1872120807219328:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1895us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.064918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1785393885.071101:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.071672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219584 00000100:00100000:0.0:1785393885.071685:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219584 00000100:00100000:0.0:1785393885.071819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:0.0:1785393885.071831:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:10531:x1872120807219584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393885.071860:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393885.071895:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a201 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd77a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072027:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072064:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072077:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393885.072091:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1785393885.072211:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072220:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072228:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072235:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.072240:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072248:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072262:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393885.072266:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785393885.072271:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072325:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a201 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd77a expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072346:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:0.0:1785393885.072349:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785393885.072352:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a201 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd77a expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.072364:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044a00, rc 0) 00000100:00100000:0.0:1785393885.072457:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807219584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 628us (1371us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1785393885.072466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1785393885.083234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.090892:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219712 00000100:00100000:2.0:1785393885.090912:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219712 00000100:00100000:2.0:1785393885.091011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1785393885.091023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807219712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1785393885.091073:0:5832:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785393885.091209:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc12a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807219712:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 187us (7988us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393885.091217:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1785393885.100206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.114622:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807219968 00000100:00100000:2.0:1785393885.114667:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807219968 00000100:00100000:3.0:1785393885.115112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1785393885.115127:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807219968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393885.115155:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393885.115167:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785393885.115203:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb800/0xcc9b96d8b362a1a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd75e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.115226:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:3.0:1785393885.115232:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393885.115250:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a216 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd781 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785393885.116243:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1785393885.117078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a21d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.117096:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.117110:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a21d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.117179:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a216 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd781 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.117197:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a21d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd781 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.117207:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acd8302f00) 00010000:00010000:3.0:1785393885.117210:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393885.117214:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1000, rc 0) 00000100:00100000:3.0:1785393885.117361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10531:x1872120807219968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2237us (17166us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1785393885.117397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1785393885.132967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.133290:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807220224 00000100:00100000:0.0:1785393885.133304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807220224 00000100:00100000:0.0:1785393885.133380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1785393885.133392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10531:x1872120807220224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785393885.133484:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393885.133518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a21d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd781 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.133543:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acd8302f00) 00010000:00010000:0.0:1785393885.133556:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393885.133629:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.133646:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.133657:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138754:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138792:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138874:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138883:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138890:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138896:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.138900:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138908:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138920:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:0.0:1785393885.138923:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393885.138928:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138934:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a22b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138961:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138967:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138973:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138978:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.138981:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138987:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.138995:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9638ed33 (ffff93acd96a4e00) 00010000:00010000:0.0:1785393885.138997:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393885.139001:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.139006:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a232 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9638ed33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.139172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807220224:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 5777us (6214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785393885.139180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:3.0:1785393885.153686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.153756:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807220352 00000100:00100000:1.0:1785393885.153780:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807220352 00000100:00100000:1.0:1785393885.153875:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1785393885.153887:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:10531:x1872120807220352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.153920:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393885.153954:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a239 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd788 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154007:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154049:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154062:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154175:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a239 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 58 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154195:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 57 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.154204:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.154207:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785393885.154211:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba800, rc 0) 00000100:00100000:1.0:1785393885.154298:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10531:x1872120807220352:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 413us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.154306:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1785393885.165947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.166387:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807220608 00000100:00100000:2.0:1785393885.166397:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807220608 00000100:00100000:2.0:1785393885.168564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1785393885.168613:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:10531:x1872120807220608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785393885.168885:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.168902:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.168914:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785393885.169141:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1785393885.169150:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417200579288ns, next at 418200577030ns, rc = 0 00000004:00010000:3.0:1785393885.169227:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004648e2f9 reply state 0000000058608c53 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.169237:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393885.169342:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:10531:x1872120807220608:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 746us (3402us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1785393885.169349:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00010000:00010000:0.0:1785393885.175483:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175517:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175524:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175531:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.175547:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175556:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175716:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393885.175720:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785393885.175726:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.175733:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.175795:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.176469:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807220736 00000100:00100000:0.0:1785393885.176486:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807220736 00000100:00100000:0.0:1785393885.176658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1785393885.176674:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:10531:x1872120807220736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393885.176718:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393885.176751:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd78f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.176849:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.176883:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.176910:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393885.176913:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393885.176917:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045200, rc 0) 00000100:00100000:0.0:1785393885.176994:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:10531:x1872120807220736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 324us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.177003:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1785393885.181042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.181321:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807220864 00000100:00100000:1.0:1785393885.181335:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807220864 00000100:00100000:1.0:1785393885.181426:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1785393885.181449:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807220864:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1785393885.181870:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2358:x1872120807220864:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 432us (841us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1785393885.181878:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00080000:0.0:1785393885.182048:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393885.195721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.195824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807221120 00000100:00100000:2.0:1785393885.195837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807221120 00000100:00100000:2.0:1785393885.195918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1785393885.195930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:10531:x1872120807221120:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785393885.196210:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:10531:x1872120807221120:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 281us (509us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1785393885.196217:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1785393885.210885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.220606:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807221376 00000100:00100000:0.0:1785393885.220620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807221376 00000100:00100000:0.0:1785393885.220694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1785393885.220704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:10531:x1872120807221376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785393885.220992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:10531:x1872120807221376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 278us (10104us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.221008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1785393885.223813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.223906:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807221504 00000100:00100000:1.0:1785393885.223917:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807221504 00000100:00100000:1.0:1785393885.223976:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1785393885.223986:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:10531:x1872120807221504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.224010:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393885.224036:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a255 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd796 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224119:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224135:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224148:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393885.224192:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393885.224213:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224242:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a255 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd796 expref: 62 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224541:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd796 expref: 61 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.224728:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.224731:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785393885.224735:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bba00, rc 0) 00000100:00100000:1.0:1785393885.224849:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:10531:x1872120807221504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 863us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.224858:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1785393885.236360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.236455:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807221632 00000100:00100000:1.0:1785393885.236467:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807221632 00000100:00100000:1.0:1785393885.236541:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1785393885.236553:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807221632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.236614:0:8307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393885.236649:0:8307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd79d expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785393885.236692:0:8307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6af2dc, blocks: 0x1 00010000:00010000:1.0:1785393885.236721:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1785393885.236727:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393885.236739:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 10 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.236762:0:8307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 10 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.236785:0:8307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba400, rc 0) 00000100:00100000:1.0:1785393885.237013:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807221632:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 455us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.237021:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1785393885.239964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.240098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807221888 00000100:00100000:0.0:1785393885.240108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807221888 00000100:00100000:0.0:1785393885.240168:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:0.0:1785393885.240179:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:10531:x1872120807221888:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785393885.240304:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:10531:x1872120807221888:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.240311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1785393885.244706:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.244808:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222016 00000100:00100000:1.0:1785393885.244825:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222016 00000100:00100000:1.0:1785393885.245102:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1785393885.245113:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:10531:x1872120807222016:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.245134:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393885.245167:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7a4 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.245207:0:6630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.245216:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393885.245220:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393885.245225:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 11 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.245261:0:6630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.245995:0:6630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.246009:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831358336:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393885.246117:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d480 going to sleep for 11 seconds 00000100:00100000:1.0:1785393885.249103:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831358336:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393885.249153:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 11 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.249183:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bac00, rc 0) 00000100:00100000:1.0:1785393885.249255:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:10531:x1872120807222016:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4143us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393885.249265:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1785393885.250754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.250837:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222144 00000100:00100000:2.0:1785393885.250847:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222144 00010000:00010000:2.0:1785393885.250896:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.250974:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1785393885.250984:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:2359:x1872120807222144:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393885.251000:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393885.251027:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.251063:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.251092:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362a263 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd79d expref: 11 pid: 8307 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.251109:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393885.251114:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393885.251124:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 10 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.251136:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 10 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.251175:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 10 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.251191:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1872120831358464:192.168.203.12@tcp:105: 00000100:00100000:2.0:1785393885.251277:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b300 going to sleep for 11 seconds 00000100:00100000:3.0:1785393885.256655:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1872120831358464:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785393885.256689:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393885.256835:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807222144:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5851us (6083us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.256865:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1785393885.257203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.258671:0:6635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222272 00000100:00100000:0.0:1785393885.258681:0:6635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222272 00002000:00100000:0.0:1785393885.258740:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93acf7ea7800 x1872120807222272/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:96/0 lens 504/0 e 0 to 0 dl 1785393896 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393885.258767:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7ea7800 with x1872120807222272 ext(0->12) 00002000:00010000:0.0:1785393885.258773:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7ea7800 00000100:00100000:0.0:1785393885.258807:0:6635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1785393885.258816:0:6635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807222272:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1785393885.259455:0:6635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:2359:x1872120807222272:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 638us (2251us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1785393885.259462:0:6635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:0.0:1785393885.259469:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93acf7ea7800 x1872120807222272/t4294967308(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:96/0 lens 504/448 e 0 to 0 dl 1785393896 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393885.259477:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7ea7800 with x1872120807222272 ext(0->12) 00002000:00010000:0.0:1785393885.259480:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7ea7800 00000100:00100000:1.0:1785393885.261698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.261781:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222400 00000100:00100000:3.0:1785393885.261791:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222400 00000100:00100000:3.0:1785393885.261869:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1785393885.261880:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:10531:x1872120807222400:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1785393885.279728:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393885.369648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:10531:x1872120807222400:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 107753us (107942us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.369666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000001:00080000:2.0:1785393885.370019:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:2.0:1785393885.370038:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1785393885.370066:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ad005e0780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1785393885.370071:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ad005e0b40 00000020:00080000:2.0:1785393885.370075:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acffb12800 00000020:00080000:2.0:1785393885.370143:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acc955c240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1785393885.370147:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081c400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acc955c0c0 00000020:00080000:2.0:1785393885.370150:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acf8a3a000 00000004:00080000:2.0:1785393885.370182:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1785393885.370202:0:5853:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1785393885.370210:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1785393885.370234:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1785393885.370323:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1785393885.370753:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1785393885.370913:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393885.370931:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831358592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785393885.371061:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393885.371149:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831358720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785393885.371175:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393885.371211:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831358592 00000100:00100000:3.0:1785393885.371219:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831358592 00000100:00100000:3.0:1785393885.371273:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831358720 00000100:00100000:3.0:1785393885.371277:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831358720 00000100:00100000:3.0:1785393885.371300:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785393885.371732:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3317:x1872120831358592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785393885.371763:0:8307:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1785393885.371795:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.371819:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 11 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.371843:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1785393885.371848:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393885.371853:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.371886:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 11 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.371902:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 11 pid: 6632 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.371915:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831358848:192.168.203.12@tcp:104: 00000100:00080000:2.0:1785393885.372071:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393885.372091:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785393885.372100:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1872120831358720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1785393885.372251:0:6631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785393885.372255:0:6631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785393884 00002000:00010000:2.0:1785393885.372257:0:6631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785393885.372259:0:6631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1785393884 -> 1785393884 00002000:00010000:2.0:1785393885.372262:0:6631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1785393885.372360:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2dfacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393885.377794:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3315:x1872120831358720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5681us (6603us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1785393885.377812:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785393885.378060:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831358976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785393885.378116:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393885.378252:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831358976 00000100:00100000:0.0:1785393885.378263:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831358976 00000100:00100000:0.0:1785393885.378348:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785393885.378358:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831358976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785393885.378396:0:6632:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1785393885.378452:0:6632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a6af2da, atime: 0x6a6af2da, ctime: 0x6a6af2da, blocks: 0x1 00010000:00010000:0.0:1785393885.378462:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.378482:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1785393885.378502:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1785393885.378672:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785393885.378768:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.378789:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.378801:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.378810:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.378828:0:6632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785393885.379098:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393885.379106:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.379115:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393885.379127:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.379138:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.379159:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.379167:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cd7f1db/0xcc9b96d8b362a278 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.379190:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393885.379192:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393885.379194:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393885.380293:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1872120831358976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1933us (2172us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1785393885.380304:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1785393885.380887:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf7e7dc00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1785393885.380896:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831358720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1785393885.381114:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acff9ac700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1785393885.381121:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831358976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785393885.381222:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.381748:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222528 00000100:00100000:2.0:1785393885.381756:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222528 00000100:00100000:2.0:1785393885.381842:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1785393885.381853:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:2359:x1872120807222528:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1785393885.382068:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393885.382283:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222656 00000100:00100000:2.0:1785393885.382287:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222656 00010000:00010000:2.0:1785393885.382321:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 13 pid: 6632 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.382354:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1785393885.382372:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807222656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393885.382385:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393885.382392:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 13 pid: 6632 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382406:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 13 pid: 6632 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382434:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393885.382447:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393885.382454:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382465:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382488:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393885.382709:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807222656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 336us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393885.382717:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00010000:00010000:2.0:1785393885.382776:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362a033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd703 expref: 12 pid: 6632 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.382793:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831358848:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393885.382819:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382844:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382853:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382863:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382872:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.382892:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785393885.384066:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3317:x1872120831358592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12756us (13003us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1785393885.384075:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1785393885.384189:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf7ea6a00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1785393885.384196:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831358592:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1785393885.391860:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393885.391878:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.391893:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393885.391899:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.391912:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.391958:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.391967:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.391992:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393885.391995:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393885.391997:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785393885.427880:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1785393885.427916:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1785393885.427923:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1785393885.428159:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807222528:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 46299us (46929us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393885.428172:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1785393885.430931:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.431065:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807222912 00000100:00100000:0.0:1785393885.431078:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807222912 00000100:00100000:0.0:1785393885.431149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:0.0:1785393885.431161:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10531:x1872120807222912:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785393885.431231:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393885.431267:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a25c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd796 expref: 15 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.431299:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:0.0:1785393885.431305:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393885.431373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.431389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.431400:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393885.431947:0:5832:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000856be632 reply state 000000006bd52df9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.431959:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393885.432071:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:10531:x1872120807222912:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 911us (1157us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1785393885.432079:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1785393885.434850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.434920:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223040 00000100:00100000:0.0:1785393885.434929:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223040 00000100:00100000:0.0:1785393885.434991:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1785393885.435000:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807223040:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1785393885.435267:0:6630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1785393885.435271:0:6630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1785393884 -> 1785393883 00002000:00010000:0.0:1785393885.435284:0:6630:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785393882 00002000:00010000:0.0:1785393885.435287:0:6630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1785393884 -> 1785393883 00002000:00010000:0.0:1785393885.435289:0:6630:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1785393885.435363:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807223040:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 362us (521us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1785393885.435371:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00010000:00010000:1.0:1785393885.436144:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436157:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436165:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436171:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.436177:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436185:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436222:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.436225:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393885.436230:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.436237:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a27f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.438395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.438612:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223296 00000100:00100000:1.0:1785393885.438622:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223296 00000100:00100000:1.0:1785393885.438669:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:1.0:1785393885.438678:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:10531:x1872120807223296:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.438755:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.438772:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 15 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.438783:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.438824:0:10972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 15 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.438840:0:10972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 15 pid: 10972 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.438858:0:10972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831359104:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393885.439105:0:10972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d300 going to sleep for 11 seconds 00000100:00100000:2.0:1785393885.445076:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393885.445253:0:10972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831359104:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393885.445294:0:10972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.445605:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223424 00000100:00100000:3.0:1785393885.445613:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223424 00010000:00010000:3.0:1785393885.445675:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 16 pid: 10972 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.445720:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:3.0:1785393885.445731:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:2359:x1872120807223424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393885.445747:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393885.445756:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 16 pid: 10972 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445770:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 16 pid: 10972 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445796:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd788 expref: 16 pid: 10972 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445812:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:3.0:1785393885.445818:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445828:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445837:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.445864:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393885.445942:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:2359:x1872120807223424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 206us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.445950:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00010000:00010000:1.0:1785393885.446524:0:10972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446533:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446606:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446615:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446622:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446628:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbe00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.446633:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446641:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446651:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.446655:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1785393885.446659:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.446676:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a286 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.446730:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10531:x1872120807223296:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 8052us (8344us total) trans 0 rc -22/-22 00000100:00100000:1.0:1785393885.446740:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1785393885.449597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.449679:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223552 00000100:00100000:3.0:1785393885.449688:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223552 00000100:00100000:3.0:1785393885.449743:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1785393885.449754:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807223552:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785393885.449804:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.449825:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 7 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.449835:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393885.449839:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393885.449844:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.449880:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 7 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.449896:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 7 pid: 6630 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.449913:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831359232:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393885.450010:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd9b1cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393885.452205:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831359232:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393885.452235:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.453822:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.453922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223680 00000100:00100000:0.0:1785393885.453946:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223680 00010000:00010000:0.0:1785393885.453987:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 8 pid: 6630 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.454031:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:0.0:1785393885.454042:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807223680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393885.454059:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393885.454089:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 8 pid: 6630 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.454102:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 8 pid: 6630 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.454131:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362a26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7a4 expref: 8 pid: 6630 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.454150:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785393885.454155:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785393885.454160:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.454169:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.454203:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393885.454271:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807223680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 225us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.454288:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00010000:00010000:2.0:1785393885.454976:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.454987:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455030:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455038:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455046:0:8307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455054:0:8307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393885.455058:0:8307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455067:0:8307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455080:0:8307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393885.455089:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a28d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.455153:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807223552:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 5400us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393885.455162:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1785393885.458089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.458460:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807223936 00000100:00100000:0.0:1785393885.458470:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807223936 00000100:00100000:1.0:1785393885.458772:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1785393885.458786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10531:x1872120807223936:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785393885.458883:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.458902:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459038:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459503:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459628:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459639:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459679:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.459709:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 15 pid: 5832 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393885.459726:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831359360:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393885.459865:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d300 going to sleep for 11 seconds 00000100:00100000:1.0:1785393885.463172:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831359360:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393885.463203:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.463345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.463896:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807224064 00000100:00100000:3.0:1785393885.463904:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807224064 00010000:00010000:3.0:1785393885.463953:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 16 pid: 5832 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393885.464018:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1785393885.464030:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+16:2359:x1872120807224064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393885.464047:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393885.464055:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 16 pid: 5832 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464068:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 16 pid: 5832 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464091:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a24e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd78f expref: 16 pid: 5832 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464112:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:3.0:1785393885.464117:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464128:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464136:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.464167:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393885.464221:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:2359:x1872120807224064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 193us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.464229:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00010000:00010000:1.0:1785393885.464295:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.464304:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785393885.464554:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1785393885.464748:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1785393885.464797:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1785393885.464888:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831359488:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785393885.464944:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393885.464973:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d480 going to sleep for 11 seconds 00000100:00100000:3.0:1785393885.465347:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831359488 00000100:00100000:3.0:1785393885.465362:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831359488 00000100:00100000:3.0:1785393885.465402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785393885.465411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1872120831359488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785393885.465517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1872120831359488:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.465524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785393885.465827:0:5833:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1785393885.465833:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf7ab2a00, transno 4294967303 00000004:00080000:1.0:1785393885.465853:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1785393885.465874:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf7e7dc00, transno 4294967309 00000004:00080000:1.0:1785393885.465878:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf7ea6a00, transno 4294967310 00000100:00100000:1.0:1785393885.465885:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831359488:0@lo:1000:mdt00_002.0 00000004:00080000:3.0:1785393885.466682:0:6673:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:1.0:1785393885.467083:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1785393885.467152:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831359616:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785393885.467197:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393885.467228:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d300 going to sleep for 11 seconds 00000100:00100000:3.0:1785393885.468182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831359616 00000100:00100000:3.0:1785393885.468190:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831359616 00000100:00100000:3.0:1785393885.468239:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785393885.468249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1872120831359616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785393885.468786:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1872120831359616:12345-0@lo:1000:mdt00_002.0 Request processed in 538us (1587us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1785393885.468795:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785393885.469187:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831359616:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1785393885.469230:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469243:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469252:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469260:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.469279:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469289:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469448:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acc3c44d00) 00010000:00010000:1.0:1785393885.469452:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393885.469459:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a29b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469503:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469689:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469695:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469701:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393885.469705:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469712:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469722:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393885.469724:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393885.469732:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 18 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469745:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 18 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393885.469756:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 18 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.469863:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 18 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.469880:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831359744:192.168.203.12@tcp:105: 00000100:00100000:0.0:1785393885.469976:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63480 going to sleep for 11 seconds 00000100:00100000:2.0:1785393885.473188:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.473275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807224192 00000100:00100000:3.0:1785393885.473285:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807224192 00000100:00100000:3.0:1785393885.473349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1785393885.473360:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10530:x1872120807224192:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:3.0:1785393885.473525:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:10530:x1872120807224192:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 166us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.473533:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1785393885.474501:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831359744:192.168.203.12@tcp:105: 00010000:00010000:0.0:1785393885.474541:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474551:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a1de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474612:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474627:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474639:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474650:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474657:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474684:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474690:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.474694:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474703:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474716:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393885.474720:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393885.474724:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474730:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474740:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474746:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474752:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474757:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbe00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393885.474760:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474776:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474784:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393885.474786:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785393885.474789:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.474794:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a294 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.475034:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:10531:x1872120807223936:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 16252us (16953us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1785393885.475044:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000020:00080000:0.0:1785393885.475049:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1785393885.475415:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393885.475421:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785393885.475952:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1785393885.475961:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785393885.478186:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.478294:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807224448 00000100:00100000:3.0:1785393885.478313:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807224448 00000100:00100000:3.0:1785393885.478370:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1785393885.478382:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd043050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:10531:x1872120807224448:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1785393885.479207:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1785393885.479349:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1785393885.479397:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479414:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479428:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479448:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479456:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479463:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.479490:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785393885.479615:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd043050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:10531:x1872120807224448:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1234us (1435us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1785393885.479624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000020:00080000:3.0:1785393885.479629:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785393885.480042:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785393885.480050:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.480058:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785393885.480063:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.480071:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.480086:0:7522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93acd8302100) 00010000:00010000:0.0:1785393885.480089:0:7522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785393885.480094:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.480113:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0000/0xcc9b96d8b362a2a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.480131:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393885.480133:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393885.480135:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393885.483744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.483824:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807224704 00000100:00100000:0.0:1785393885.483835:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807224704 00000100:00100000:0.0:1785393885.483896:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:0.0:1785393885.483908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:10530:x1872120807224704:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:0.0:1785393885.484210:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1785393885.484372:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:10530:x1872120807224704:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 465us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.484380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1785393885.516180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.516301:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807224832 00000100:00100000:0.0:1785393885.516323:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807224832 00000100:00100000:0.0:1785393885.516399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1785393885.516411:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:10533:x1872120807224832:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393885.516454:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393885.516483:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516617:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516668:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516687:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516695:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.516702:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.517217:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.517229:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.517238:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.517423:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.517449:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 21 pid: 5831 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.517464:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831359872:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393885.517690:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2d63480 going to sleep for 11 seconds 00000100:00100000:0.0:1785393885.521402:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831359872:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393885.521447:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393885.522209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393885.522302:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225088 00000100:00100000:3.0:1785393885.522362:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225088 00000100:00100000:3.0:1785393885.522428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1785393885.522449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:5580:x1872120807225088:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1785393885.522870:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:5580:x1872120807225088:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 431us (661us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1785393885.522897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1785393885.524705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393885.524790:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225216 00000100:00100000:0.0:1785393885.524797:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225216 00010000:00010000:0.0:1785393885.524831:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 23 pid: 5831 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393885.524867:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1785393885.524876:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8528850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:2359:x1872120807225216:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393885.524889:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393885.524897:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 23 pid: 5831 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.524919:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 23 pid: 5831 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.524945:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a1d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd76c expref: 23 pid: 5831 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.524964:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393885.524969:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.524980:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.524988:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393885.525034:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393885.525077:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8528850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2359:x1872120807225216:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 201us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.525084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00010000:00010000:3.0:1785393885.525722:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525731:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393885.525776:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1785393885.525781:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393885.525802:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525817:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525828:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525834:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525840:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525846:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393885.525851:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525859:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525871:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:3.0:1785393885.525881:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393885.525886:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525892:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a2b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525907:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525961:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525969:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525973:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393885.525976:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525981:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.525989:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93acd96a4c00) 00010000:00010000:3.0:1785393885.525992:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393885.525994:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.526000:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a2be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.526041:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a2b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ab expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.526070:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ab expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393885.526078:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:3.0:1785393885.526081:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393885.526084:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045200, rc 0) 00000100:00100000:3.0:1785393885.526128:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10533:x1872120807224832:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 9719us (9962us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.526136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1785393885.729290:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831360128:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729390:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393885.729477:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393885.729484:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831360000:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729517:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393885.729553:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831360384:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393885.729630:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393885.729635:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831360256:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729657:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393885.729688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360128 00000100:00100000:0.0:1785393885.729703:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360128 00000100:00100000:0.0:1785393885.729754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360384 00000100:00100000:0.0:1785393885.729757:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360384 00000100:00100000:0.0:1785393885.729784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360256 00000100:00100000:0.0:1785393885.729787:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360256 00000100:00100000:0.0:1785393885.729807:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1785393885.729816:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831360128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729877:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831360128:12345-0@lo:400:kworker.0 Request processed in 61us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.729885:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1785393885.729905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1785393885.729934:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831360384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.729970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831360384:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.729976:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1785393885.729989:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785393885.729994:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831360256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.730019:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831360256:12345-0@lo:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393885.730024:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1785393885.730039:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393885.730073:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831360256:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.730084:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831360384:0@lo:400:kworker.0 00000100:00100000:0.0:1785393885.730115:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831360128:0@lo:400:kworker.0 00000100:00100000:3.0:1785393885.731653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360000 00000100:00100000:3.0:1785393885.731663:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360000 00000100:00100000:3.0:1785393885.731772:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1785393885.731781:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831360000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393885.731868:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831360000:12345-0@lo:400:kworker.0 Request processed in 89us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393885.731875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1785393885.731934:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831360000:0@lo:400:kworker.0 00000100:00100000:3.0:1785393886.240973:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393886.241001:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831360512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393886.241087:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393886.241176:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360512 00000100:00100000:3.0:1785393886.241184:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360512 00000100:00100000:3.0:1785393886.241237:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785393886.241248:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831360512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393886.241295:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393886.242016:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831360512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 768us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393886.242024:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785393886.249415:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831360512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393886.305938:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393886.499833:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393886.499843:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393886.499883:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1785393886.499891:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785393886.500031:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831360640:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785393886.501208:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57300 going to sleep for 11 seconds 00000100:00100000:3.0:1785393886.511298:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831360640:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785393886.514045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393886.514134:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225344 00000100:00100000:0.0:1785393886.514145:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225344 00000100:00100000:0.0:1785393886.514231:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1785393886.514242:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10544:x1872120807225344:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785393886.514298:0:5831:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785393886.514447:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10544:x1872120807225344:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 206us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393886.514456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00080000:1.0:1785393886.514959:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393886.524986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393886.529822:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225600 00000100:00100000:3.0:1785393886.529841:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225600 00000100:00100000:3.0:1785393886.529910:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1785393886.529921:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:10544:x1872120807225600:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393886.529947:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393886.529972:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7b2 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.530090:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a2d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.530107:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.530120:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393886.530240:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1785393886.530486:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b2 expref: 24 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.530505:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b2 expref: 23 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.530515:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:3.0:1785393886.530519:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393886.530522:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1e00, rc 0) 00000100:00100000:3.0:1785393886.530712:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:10544:x1872120807225600:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 792us (5739us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1785393886.530720:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1785393886.549677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393886.549769:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393886.550680:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225728 00000100:00100000:3.0:1785393886.550693:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225728 00000100:00100000:3.0:1785393886.550777:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1785393886.550790:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:2359:x1872120807225728:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393886.550810:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393886.550841:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a2d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b2 expref: 23 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.550861:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:3.0:1785393886.550867:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393886.551101:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2359:x1872120807225728:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 313us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393886.551110:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1785393886.555763:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807225984 00000100:00100000:2.0:1785393886.555784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807225984 00000100:00100000:2.0:1785393886.555864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1785393886.555875:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:10544:x1872120807225984:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785393886.555971:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.555992:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556006:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556226:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556234:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556241:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556247:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393886.556252:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556282:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556296:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:2.0:1785393886.556300:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785393886.556646:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393886.556654:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a2e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393886.556883:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:10544:x1872120807225984:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 1007us (7214us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1785393886.556892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000040:00080000:0.0:1785393886.566153:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393886.566163:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393886.566733:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1785393886.566745:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785393886.567089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393886.567229:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807226240 00000100:00100000:0.0:1785393886.567239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807226240 00000100:00100000:0.0:1785393886.567537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1785393886.567550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:10544:x1872120807226240:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785393886.567902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:10544:x1872120807226240:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 354us (818us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1785393886.567910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000040:00080000:1.0:1785393886.681390:0:11941:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393886.681402:0:11941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785393886.681465:0:11941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1785393886.681472:0:11941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785393886.763763:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831360768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393886.763856:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393886.764013:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360768 00000100:00100000:2.0:1785393886.764022:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360768 00000100:00100000:2.0:1785393886.764077:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393886.764087:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831360768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785393886.764114:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1785393886.764168:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831360768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393886.764176:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785393886.764240:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831360768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393886.903972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393886.904138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807226496 00000100:00100000:0.0:1785393886.904150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807226496 00000100:00100000:0.0:1785393886.904222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1785393886.904234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:10557:x1872120807226496:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393886.904277:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393886.904313:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b362a2e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7b9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393886.904729:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a2ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393886.904757:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a2ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393886.904771:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a2ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393886.904792:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1785393886.904957:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044c00/0xcc9b96d8b362a2e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b9 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393886.904977:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a2ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b9 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393886.904987:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:0.0:1785393886.904990:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1785393886.904994:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044a00, rc 0) 00000100:00100000:0.0:1785393886.905107:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:10557:x1872120807226496:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 874us (1146us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1785393886.905116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1785393886.913029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393886.913144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807226624 00000100:00100000:3.0:1785393886.913157:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807226624 00000100:00100000:3.0:1785393886.913226:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1785393886.913237:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:10557:x1872120807226624:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1785393886.913347:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913368:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913774:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913814:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913822:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913830:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913836:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393886.913841:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913849:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:3.0:1785393886.913865:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393886.913886:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393886.913893:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a2fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393886.914004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:10557:x1872120807226624:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 768us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393886.914013:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1785393887.068510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393887.068829:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807226752 00000100:00100000:0.0:1785393887.068842:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807226752 00000100:00100000:0.0:1785393887.068921:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1785393887.068934:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807226752:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1785393887.068955:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393887.068979:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2bced6a/0xcc9b96d8b362a304 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7c0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393887.069010:0:6630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a6af2db, atime: 0x6a6af2da, ctime: 0x6a6af2db, blocks: 0xb 00010000:00010000:0.0:1785393887.069034:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1785393887.069039:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393887.069050:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2bced6a/0xcc9b96d8b362a304 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c0 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393887.069089:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2bced6a/0xcc9b96d8b362a304 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c0 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393887.069105:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044c00, rc 0) 00000100:00100000:0.0:1785393887.069166:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807226752:12345-192.168.203.12@tcp:101:cat.0 Request processed in 236us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393887.069173:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00080000:1.0:1785393887.069406:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393887.075056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393887.075151:0:6636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807226880 00000100:00100000:0.0:1785393887.075163:0:6636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807226880 00002000:00100000:0.0:1785393887.075224:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93acf7e7d180 x1872120807226880/t0(0) o3->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:98/0 lens 488/0 e 0 to 0 dl 1785393898 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393887.075236:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7e7d180 with x1872120807226880 ext(0->4095) 00002000:00010000:0.0:1785393887.075243:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7e7d180 00000100:00100000:0.0:1785393887.075286:0:6636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1785393887.075297:0:6636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807226880:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:0.0:1785393887.075863:0:6636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807226880:12345-192.168.203.12@tcp:3:cat.0 Request processed in 565us (818us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1785393887.075873:0:6636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:0.0:1785393887.075881:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93acf7e7d180 x1872120807226880/t0(0) o3->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:98/0 lens 488/4536 e 0 to 0 dl 1785393898 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393887.075888:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7e7d180 with x1872120807226880 ext(0->4095) 00002000:00010000:0.0:1785393887.075892:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7e7d180 00010000:00010000:2.0:1785393887.327775:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393887.437098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393887.437151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393887.437179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393887.437235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393887.437441:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227264 00000100:00100000:0.0:1785393887.437459:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227264 00000100:00100000:0.0:1785393887.437542:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1785393887.437555:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2361:x1872120807227264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393887.437663:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2361:x1872120807227264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 111us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393887.437672:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1785393887.437699:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227136 00000100:00100000:0.0:1785393887.437702:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227136 00000100:00100000:0.0:1785393887.437728:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227392 00000100:00100000:0.0:1785393887.437731:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227392 00000100:00100000:0.0:1785393887.437756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1785393887.437762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:2361:x1872120807227136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393887.437793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:2361:x1872120807227136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393887.437799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1785393887.437812:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:0.0:1785393887.437819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807227392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393887.437844:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2361:x1872120807227392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393887.437850:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00080000:2.0:1785393887.438189:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393887.438195:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393887.438393:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227008 00000100:00100000:3.0:1785393887.438398:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227008 00000100:00100000:3.0:1785393887.438442:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 309 00000100:00100000:3.0:1785393887.438448:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807227008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393887.438476:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807227008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393887.438481:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 309 00000001:00080000:0.0:1785393887.907119:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1785393887.907140:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1785393888.351798:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785393888.608243:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393888.608256:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393888.608297:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1785393888.608316:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1785393889.378633:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785393890.380495:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1785393890.380530:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acff99d480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1785393890.380536:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acc2bcbc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acff99d840 00000020:00080000:0.0:1785393890.380540:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acc2bcb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acffb11400 00000020:00080000:0.0:1785393890.380614:0:5853:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1785393890.385322:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1785393890.385631:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1785393890.400512:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393890.849995:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831360896:0@lo:400:kworker.0 00000100:00100000:0.0:1785393890.850088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393890.850150:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393890.850156:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831361024:0@lo:400:kworker.0 00000100:00100000:0.0:1785393890.850184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393890.850215:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831360896 00000100:00100000:0.0:1785393890.850223:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831360896 00000100:00100000:2.0:1785393890.850512:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361280:0@lo:400:kworker.0 00000100:00100000:2.0:1785393890.850551:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393890.850602:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393890.850609:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831361152:0@lo:400:kworker.0 00000100:00100000:2.0:1785393890.850631:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393890.850657:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361280 00000100:00100000:2.0:1785393890.850661:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361280 00000100:00100000:0.0:1785393890.855499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361024 00000100:00100000:0.0:1785393890.855515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361024 00000100:00100000:0.0:1785393890.855592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361152 00000100:00100000:0.0:1785393890.855596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361152 00000100:00100000:0.0:1785393890.855631:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1785393890.855643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831361024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.856197:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1785393890.856210:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393890.858049:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831361024:12345-0@lo:400:kworker.0 Request processed in 2401us (7856us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393890.858062:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1785393890.858097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1785393890.858112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831361152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393890.858180:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831361152:12345-0@lo:400:kworker.0 Request processed in 74us (7547us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393890.858205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1785393890.863060:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831360896:12345-0@lo:400:kworker.0 Request processed in 6840us (12958us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393890.863077:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1785393890.863194:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831361408:0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.863276:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393890.863346:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831361024:0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.863359:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831360896:0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.863430:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361408 00000100:00100000:3.0:1785393890.863439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361408 00000100:00100000:3.0:1785393890.863492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785393890.863502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831361408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.864088:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831361408:12345-0@lo:400:kworker.0 Request processed in 586us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393890.864095:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785393890.864133:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831361408:0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.864180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393890.864186:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831361536:0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.864217:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785393890.864314:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785393890.864321:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393890.864455:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831361152:0@lo:400:kworker.0 00000100:00100000:2.0:1785393890.866906:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361536 00000100:00100000:2.0:1785393890.866923:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361536 00000100:00080000:2.0:1785393890.883822:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393890.884223:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1785393890.884260:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831361280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393890.885208:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831361280:12345-0@lo:400:kworker.0 Request processed in 965us (34650us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393890.885219:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1785393890.885255:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785393890.885266:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831361536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393890.887287:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1785393890.887300:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1785393890.887335:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acff9ac700, transno 4294967304 00000100:00100000:3.0:1785393890.887361:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831361536:0@lo:400:kworker.0 00000100:00100000:2.0:1785393890.888358:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831361536:12345-0@lo:400:kworker.0 Request processed in 2633us (23677us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393890.888410:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785393890.888775:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361280:0@lo:400:kworker.0 00000001:00080000:0.0:1785393891.042224:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1785393891.042243:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1785393891.362366:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393891.362387:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393891.362463:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393891.362979:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361664 00000100:00100000:1.0:1785393891.362987:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361664 00000100:00100000:1.0:1785393891.363050:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785393891.363060:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831361664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393891.363093:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393891.363134:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831361664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393891.363142:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785393891.363259:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393891.431444:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393891.899796:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393891.899862:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393891.909414:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361792 00000100:00100000:0.0:1785393891.909427:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361792 00000100:00100000:0.0:1785393891.909474:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785393891.909483:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831361792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393891.909521:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785393891.909622:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831361792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (9759us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393891.909629:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785393891.909683:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1785393891.909689:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1785393891.909714:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831361792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785393892.447971:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393892.551171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393892.551218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393892.551262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393892.551430:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227776 00000100:00100000:3.0:1785393892.551439:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227776 00000100:00100000:3.0:1785393892.551511:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:3.0:1785393892.551522:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807227776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393892.551623:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807227776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393892.551631:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00080000:3.0:1785393892.551766:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393892.551927:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227520 00000100:00100000:0.0:1785393892.551932:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227520 00000100:00100000:0.0:1785393892.551970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00100000:0.0:1785393892.551977:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807227520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393892.552009:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807227520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393892.552016:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00100000:2.0:1785393892.552449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393892.558150:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393892.562867:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227904 00000100:00100000:0.0:1785393892.562881:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227904 00000100:00100000:0.0:1785393892.562973:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1785393892.562984:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807227904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393892.563073:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807227904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393892.563081:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00080000:2.0:1785393892.563627:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785393892.565514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228032 00000100:00100000:1.0:1785393892.565523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228032 00000100:00100000:1.0:1785393892.565623:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807227648 00000100:00100000:1.0:1785393892.565627:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807227648 00000100:00100000:1.0:1785393892.565661:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:1.0:1785393892.565671:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807228032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393892.565747:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807228032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (14485us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393892.565754:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:1.0:1785393892.565771:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:1.0:1785393892.565778:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807227648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393892.565819:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807227648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 42us (13371us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393892.565826:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00080000:2.0:1785393892.566662:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785393893.487507:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393894.502455:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393894.742743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393894.742849:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228160 00000100:00100000:1.0:1785393894.742861:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228160 00000100:00080000:2.0:1785393894.743001:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393894.743052:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1785393894.743067:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10217:x1872120807228160:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1785393894.743206:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10217:x1872120807228160:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 143us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393894.743214:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1785393894.754942:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393894.755397:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228416 00000100:00100000:3.0:1785393894.755428:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228416 00000100:00100000:3.0:1785393894.755553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1785393894.755596:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:10217:x1872120807228416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785393894.757385:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:10217:x1872120807228416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1808us (2442us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1785393894.757397:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1785393895.453100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393895.454110:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228544 00000100:00100000:2.0:1785393895.454124:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228544 00000100:00100000:2.0:1785393895.454223:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:2.0:1785393895.454236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:11011:x1872120807228544:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:2.0:1785393895.454264:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393895.454290:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a30b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7c7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454398:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454431:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393895.454708:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785393895.454713:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393895.454812:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454841:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a30b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454861:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393895.454871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:2.0:1785393895.454874:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785393895.454878:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00080000:3.0:1785393895.455156:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393895.455190:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:11011:x1872120807228544:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 956us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393895.455205:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00010000:00010000:1.0:1785393895.519975:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1785393895.547838:0:5853:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1785393895.547865:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1785393895.547879:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1785393895.547889:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1785393895.968154:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831362304:0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.968260:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393895.968363:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393895.968378:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831362176:0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.968408:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393895.968448:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362304 00000100:00100000:3.0:1785393895.968457:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362304 00000100:00100000:3.0:1785393895.968525:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785393895.968536:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831362304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.968624:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831362304:12345-0@lo:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393895.968633:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785393895.968659:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362176 00000100:00100000:3.0:1785393895.968663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362176 00000100:00100000:3.0:1785393895.968694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1785393895.968701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831362176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.968753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831362176:12345-0@lo:400:kworker.0 Request processed in 52us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393895.968759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1785393895.968778:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393895.968783:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393895.968822:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831362176:0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.968834:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831362304:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969100:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831361920:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969140:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393895.969171:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831362432:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393895.969228:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785393895.969234:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831362048:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393895.969274:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831362560:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969296:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393895.969321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362432 00000100:00100000:0.0:1785393895.969325:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362432 00000100:00100000:0.0:1785393895.969375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362048 00000100:00100000:0.0:1785393895.969379:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362048 00000100:00100000:0.0:1785393895.969398:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1785393895.969404:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831362432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969447:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831362432:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393895.969454:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1785393895.969467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1785393895.969473:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831362048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969501:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831362048:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393895.969514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1785393895.969533:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362560 00000100:00100000:0.0:1785393895.969537:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362560 00000100:00100000:0.0:1785393895.969567:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785393895.969594:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831362560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969626:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831362560:12345-0@lo:400:kworker.0 Request processed in 37us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393895.969632:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1785393895.969647:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393895.969650:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393895.969668:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831362048:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969677:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831362560:0@lo:400:kworker.0 00000100:00100000:0.0:1785393895.969685:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831362432:0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.971471:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831361920 00000100:00100000:3.0:1785393895.971481:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831361920 00000100:00100000:3.0:1785393895.971535:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1785393895.971544:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831361920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393895.971645:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831361920:12345-0@lo:400:kworker.0 Request processed in 101us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393895.971651:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1785393895.971763:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831361920:0@lo:400:kworker.0 00000100:00100000:0.0:1785393896.481685:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393896.481714:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acfb8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831362688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393896.481801:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393896.481925:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362688 00000100:00100000:1.0:1785393896.481934:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362688 00000100:00100000:1.0:1785393896.481997:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785393896.482017:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831362688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393896.482062:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393896.482116:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831362688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393896.482124:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785393896.482259:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acfb8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831362688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785393896.547881:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393896.991940:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785393896.991968:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831362816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393896.992066:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393896.992196:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362816 00000100:00100000:2.0:1785393896.992205:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362816 00000100:00100000:2.0:1785393896.992268:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785393896.992288:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831362816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785393896.992333:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393896.992403:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831362816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393896.992410:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1785393896.992662:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831362816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393897.569489:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393897.667341:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393897.667393:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393897.667441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393897.667460:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393897.667503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393897.667551:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228928 00000100:00100000:2.0:1785393897.667557:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229184 00000100:00100000:2.0:1785393897.667565:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229184 00000100:00100000:0.0:1785393897.667565:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228928 00000100:00100000:2.0:1785393897.667661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228800 00000100:00100000:2.0:1785393897.667664:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228800 00000100:00100000:3.0:1785393897.667671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807228672 00000100:00100000:3.0:1785393897.667678:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807228672 00000100:00100000:3.0:1785393897.667725:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 313 00000100:00100000:1.0:1785393897.667725:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:3.0:1785393897.667741:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807228672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393897.667743:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2361:x1872120807229184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393897.667832:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2361:x1872120807229184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393897.667841:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1785393897.682642:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229056 00000100:00100000:0.0:1785393897.682660:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229056 00000100:00100000:2.0:1785393897.682667:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:2.0:1785393897.682680:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2361:x1872120807228800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393897.682701:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1785393897.682711:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807228928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393897.682808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2361:x1872120807228672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 15069us (15478us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393897.682821:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 313 00000100:00100000:3.0:1785393897.682870:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1785393897.682878:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807229056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1785393897.682987:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393897.682993:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785393897.682996:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393897.694650:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2361:x1872120807228928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 11920us (27236us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393897.694694:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1785393897.696735:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2361:x1872120807228800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 14047us (29262us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393897.696750:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:3.0:1785393897.699203:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2361:x1872120807229056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 16315us (31688us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393897.699217:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00010000:00010000:1.0:1785393898.600605:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393898.847877:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393898.847888:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393898.848472:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1785393898.848480:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785393899.618159:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393900.645616:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393901.087906:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831363072:0@lo:400:kworker.0 00000100:00100000:3.0:1785393901.087922:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831363200:0@lo:400:kworker.0 00000100:00100000:1.0:1785393901.088176:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831362944:0@lo:400:kworker.0 00000100:00100000:2.0:1785393901.094234:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831363328:0@lo:400:kworker.0 00000100:00100000:0.0:1785393901.094369:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393901.094483:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831363584:0@lo:400:kworker.0 00000100:00100000:0.0:1785393901.094515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393901.094561:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363584 00000100:00100000:0.0:1785393901.094585:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363584 00000100:00100000:0.0:1785393901.094651:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1785393901.094661:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831363584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393901.094734:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831363584:12345-0@lo:400:kworker.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393901.094741:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1785393901.094763:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785393901.094800:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831363584:0@lo:400:kworker.0 00000100:00100000:0.0:1785393901.095171:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363072 00000100:00100000:0.0:1785393901.095176:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363072 00000100:00100000:0.0:1785393901.095212:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1785393901.095220:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831363072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393901.095278:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831363072:12345-0@lo:400:kworker.0 Request processed in 46us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393901.095286:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1785393901.095313:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831363072:0@lo:400:kworker.0 00000100:00100000:3.0:1785393901.101211:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393901.101358:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363200 00000100:00100000:3.0:1785393901.101370:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363200 00000100:00080000:3.0:1785393901.101401:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393901.101460:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1785393901.101472:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831363200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393901.101548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831363200:12345-0@lo:400:kworker.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393901.101556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1785393901.101622:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831363200:0@lo:400:kworker.0 00000100:00100000:1.0:1785393901.102422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393901.102548:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831363456:0@lo:400:kworker.0 00000100:00100000:1.0:1785393901.102614:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393901.102648:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363456 00000100:00100000:1.0:1785393901.102652:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363456 00000100:00100000:1.0:1785393901.102713:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1785393901.102721:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831363456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393901.102758:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831363456:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393901.102765:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1785393901.102798:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831363456:0@lo:400:kworker.0 00000100:00100000:2.0:1785393901.103777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393901.103814:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363328 00000100:00100000:2.0:1785393901.103818:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363328 00000100:00100000:2.0:1785393901.103867:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1785393901.103874:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831363328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393901.103914:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831363328:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393901.103919:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1785393901.103947:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831363328:0@lo:400:kworker.0 00000100:00080000:0.0:1785393901.104496:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393901.104502:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393901.106663:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831362944 00000100:00100000:3.0:1785393901.106677:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831362944 00000100:00100000:3.0:1785393901.106729:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1785393901.106740:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831362944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393901.106849:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3315:x1872120831362944:12345-0@lo:400:kworker.0 Request processed in 111us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393901.106857:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1785393901.107108:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831362944:0@lo:400:kworker.0 00000100:00100000:3.0:1785393901.599807:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831363712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393901.599896:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393901.600039:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363712 00000100:00100000:2.0:1785393901.600048:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363712 00000100:00100000:2.0:1785393901.600118:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785393901.600126:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831363712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393901.600178:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393901.606756:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831363712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6619us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393901.606779:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785393901.612112:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831363712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393901.665696:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393902.114714:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393902.114743:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831363840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393902.114974:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393902.115316:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363840 00000100:00100000:1.0:1785393902.115332:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363840 00000100:00100000:1.0:1785393902.115393:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785393902.115403:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831363840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785393902.115449:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393902.115495:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831363840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393902.115510:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785393902.115707:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831363840:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1785393902.117803:0:12146:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:44:58 (1785393898) 00010000:00010000:2.0:1785393902.687764:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393902.798286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393902.798456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393902.798561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229312 00000100:00100000:3.0:1785393902.798608:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229312 00000100:00100000:3.0:1785393902.798696:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 315 00000100:00100000:3.0:1785393902.798708:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807229312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393902.798807:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807229312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393902.798814:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 315 00000100:00100000:1.0:1785393902.799520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393902.799544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393902.799608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393902.799612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229824 00000100:00100000:2.0:1785393902.799618:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229824 00000100:00100000:2.0:1785393902.799670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229440 00000100:00100000:2.0:1785393902.799674:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229440 00000100:00100000:2.0:1785393902.799698:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1785393902.799706:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2360:x1872120807229824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393902.799724:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1785393902.799735:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2360:x1872120807229440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393902.799756:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2360:x1872120807229824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393902.799768:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2360:x1872120807229440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393902.799782:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00080000:2.0:1785393902.799804:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393902.800246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:0.0:1785393902.815257:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229568 00000100:00100000:0.0:1785393902.815274:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229568 00000100:00100000:0.0:1785393902.815533:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807229696 00000100:00100000:0.0:1785393902.815537:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807229696 00000100:00100000:3.0:1785393902.815607:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1785393902.815631:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807229568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393902.815854:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2360:x1872120807229568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 227us (17388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393902.815871:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00080000:1.0:1785393902.822534:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393902.822547:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393902.823511:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1785393902.823528:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807229696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393902.823882:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807229696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 359us (24273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393902.823891:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00010000:00010000:0.0:1785393903.711840:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393904.739259:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393905.085041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393905.085649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230080 00000100:00100000:2.0:1785393905.085663:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230080 00000100:00100000:2.0:1785393905.085760:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:2.0:1785393905.085773:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:11277:x1872120807230080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785393905.085800:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393905.085825:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a319 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7ce expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086031:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086048:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086063:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086082:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086089:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.086095:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785393905.088088:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785393905.088481:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a32e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088512:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a32e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088524:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a32e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393905.088539:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1785393905.088776:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088785:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088793:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088800:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393905.088806:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088814:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088829:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:2.0:1785393905.088832:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393905.088837:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088844:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a320 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088857:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088870:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088877:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088883:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393905.088886:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088892:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.088901:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93acc89f9200) 00010000:00010000:2.0:1785393905.088904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393905.088906:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.093655:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a327 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.100975:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a319 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ce expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.101015:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a32e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ce expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.101026:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:2.0:1785393905.101030:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393905.101049:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0000, rc 0) 00000100:00100000:2.0:1785393905.102271:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:11277:x1872120807230080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 16496us (17239us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1785393905.102283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:1.0:1785393905.117673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393905.117715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393905.117813:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230336 00000100:00100000:2.0:1785393905.117825:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230336 00000100:00100000:2.0:1785393905.117905:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1785393905.117929:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:2359:x1872120807230336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393905.117948:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393905.117980:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a32e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ce expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393905.118001:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:2.0:1785393905.118007:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393905.118072:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2359:x1872120807230336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 157us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393905.118080:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1785393905.118220:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230208 00000100:00100000:3.0:1785393905.118225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230208 00000100:00100000:3.0:1785393905.118264:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1785393905.118271:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:11277:x1872120807230208:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1785393905.118367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:11277:x1872120807230208:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 95us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393905.118374:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00010000:00010000:2.0:1785393905.759850:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785393905.767020:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:0.0:1785393906.016485:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393906.016498:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393906.017088:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1785393906.017097:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785393906.219983:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785393906.220009:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831364224:0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.220095:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393906.220182:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831364352:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.221391:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831364096:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.221435:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393906.221469:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393906.221476:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831363968:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.221509:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393906.221759:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364224 00000100:00100000:3.0:1785393906.221769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364224 00000100:00100000:3.0:1785393906.221824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364096 00000100:00100000:3.0:1785393906.221828:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364096 00000100:00100000:3.0:1785393906.221854:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785393906.221864:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831364224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393906.221935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831364224:12345-0@lo:400:kworker.0 Request processed in 72us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393906.221942:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785393906.221963:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1785393906.221969:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393906.222000:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831364096:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393906.222006:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1785393906.222021:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393906.226428:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831364096:0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.226701:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393906.226757:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831364224:0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.227652:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831363968 00000100:00100000:1.0:1785393906.227660:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831363968 00000100:00100000:1.0:1785393906.227705:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1785393906.227716:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831363968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.227766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831363968:12345-0@lo:400:kworker.0 Request processed in 52us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393906.227784:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1785393906.228425:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831364608:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.228465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393906.228514:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831363968:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.228531:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393906.228538:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831364480:0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.228564:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393906.228613:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364480 00000100:00100000:0.0:1785393906.228617:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364480 00000100:00100000:0.0:1785393906.228662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1785393906.228677:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831364480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393906.228718:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831364480:12345-0@lo:400:kworker.0 Request processed in 42us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393906.228724:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1785393906.228743:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393906.228767:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831364480:0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.228828:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364352 00000100:00100000:1.0:1785393906.228832:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364352 00000100:00100000:1.0:1785393906.228875:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364608 00000100:00100000:1.0:1785393906.228878:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364608 00000100:00100000:1.0:1785393906.228899:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785393906.228906:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831364352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.228947:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831364352:12345-0@lo:400:kworker.0 Request processed in 41us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393906.228954:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785393906.228966:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393906.228973:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831364608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.229001:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831364608:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393906.229007:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785393906.229032:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831364352:0@lo:400:kworker.0 00000100:00080000:0.0:1785393906.232673:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393906.232681:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393906.232723:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831364608:0@lo:400:kworker.0 00000100:00100000:1.0:1785393906.734587:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831364736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393906.734692:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393906.735654:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364736 00000100:00100000:3.0:1785393906.735665:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364736 00000100:00100000:3.0:1785393906.735728:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785393906.735741:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831364736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393906.735790:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393906.735878:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831364736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393906.735886:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785393906.735998:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831364736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393906.789732:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393907.245867:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831364864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393907.245959:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393907.246103:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831364864 00000100:00100000:3.0:1785393907.246114:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831364864 00000100:00100000:3.0:1785393907.246178:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785393907.246195:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831364864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393907.246256:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393907.246503:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831364864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 315us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393907.246511:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1785393907.246663:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831364864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393907.809893:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393907.907297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393907.907339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393907.907373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393907.907436:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230720 00000100:00100000:1.0:1785393907.907456:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230720 00000100:00100000:1.0:1785393907.907525:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1785393907.907534:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807230720:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393907.907627:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807230720:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393907.907635:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1785393907.907655:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230592 00000100:00100000:1.0:1785393907.907658:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230592 00000100:00100000:1.0:1785393907.907683:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1785393907.907688:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807230592:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393907.907712:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807230592:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393907.907718:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00080000:3.0:1785393907.908027:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785393907.908033:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393907.908119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230464 00000100:00100000:2.0:1785393907.908123:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230464 00000100:00100000:2.0:1785393907.908161:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 317 00000100:00100000:2.0:1785393907.908167:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807230464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393907.908196:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807230464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393907.908202:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 317 00000100:00100000:3.0:1785393907.935407:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393907.935535:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230848 00000100:00100000:2.0:1785393907.935545:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230848 00000100:00100000:2.0:1785393907.935664:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1785393907.935675:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2357:x1872120807230848:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1785393907.935705:0:6630:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629d00 00000100:00080000:2.0:1785393907.935714:0:6630:0:(import.c:65:import_set_state_nolock()) ffff93ace00c1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785393907.935746:0:6630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:2.0:1785393907.936014:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807230848:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 341us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393907.936022:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00010000:00010000:2.0:1785393907.936043:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785393907.936258:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393907.944310:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393907.944564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807230976 00000100:00100000:0.0:1785393907.944604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807230976 00000100:00100000:0.0:1785393907.944669:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1785393907.944679:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2359:x1872120807230976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393907.944745:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2359:x1872120807230976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393907.944753:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00080000:3.0:1785393907.944999:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1785393908.063983:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393908.063992:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393908.064722:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1785393908.064731:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:3.0:1785393908.365658:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:3.0:1785393908.365670:0:7533:0:(genops.c:906:class_export_put()) final put ffff93ace00c6000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:3.0:1785393908.366162:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93ace00c6000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0001 00000020:00000080:3.0:1785393908.366226:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93ace00c1000 for lustre-OST0001 00000100:00100000:3.0:1785393908.377860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393908.377971:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807231104 00000100:00100000:0.0:1785393908.377985:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807231104 00000100:00100000:0.0:1785393908.378053:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1785393908.378063:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:11319:x1872120807231104:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393908.378083:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393908.378103:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7d5 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378197:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378210:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378224:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378238:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378245:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378252:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378505:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378513:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378520:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378526:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393908.378530:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378547:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378558:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393908.378561:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393908.378565:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378591:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378603:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378609:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378615:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378619:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393908.378622:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378628:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378635:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93acd96a4900) 00010000:00010000:0.0:1785393908.378639:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393908.378642:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378656:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a34a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378685:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a33c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7d5 expref: 14 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378694:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393908.378697:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393908.378700:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7d5 expref: 14 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.378708:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045e00, rc 0) 00000100:00100000:0.0:1785393908.378776:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:11319:x1872120807231104:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 714us (932us total) trans 0 rc 301/301 00000100:00100000:0.0:1785393908.378783:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1785393908.389453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393908.389528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807231360 00000100:00100000:0.0:1785393908.389539:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807231360 00000100:00100000:0.0:1785393908.389627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:0.0:1785393908.389638:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:11319:x1872120807231360:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1785393908.389693:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393908.389718:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1600/0xcc9b96d8b3629cba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd60e expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.389737:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393908.389742:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393908.390002:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.390022:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.390031:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.390061:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.390076:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 5 pid: 5831 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393908.390089:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831364992:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393908.390186:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785393908.407139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393908.407244:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807231488 00000100:00100000:2.0:1785393908.407257:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807231488 00010000:00010000:2.0:1785393908.407307:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 6 pid: 5831 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393908.407354:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1785393908.407365:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2359:x1872120807231488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393908.407380:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393908.407388:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 6 pid: 5831 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.407403:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 6 pid: 5831 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.407425:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:2.0:1785393908.407431:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.407451:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.407459:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.407477:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393908.407538:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2359:x1872120807231488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 174us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393908.407546:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00010000:00010000:0.0:1785393908.408358:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a312 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c7 expref: 5 pid: 5831 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393908.408374:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831364992:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393908.408392:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.408401:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.408407:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.408428:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.408443:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.408451:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393908.409653:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1785393908.409663:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409671:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409678:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409684:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393908.409687:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409694:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409705:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302800) 00010000:00010000:0.0:1785393908.409708:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393908.409711:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.409717:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a351 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393908.409742:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae88469b reply state 00000000c07ffe82 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393908.409750:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393908.409811:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:11319:x1872120807231360:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 20175us (20368us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1785393908.409818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00010000:00010000:2.0:1785393908.419520:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419535:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419543:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419548:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393908.419553:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419560:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419592:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93acd96a4900) 00010000:00010000:2.0:1785393908.419595:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393908.419599:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.419623:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a358 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393908.573099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393908.574555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807231616 00000100:00100000:0.0:1785393908.574565:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807231616 00000100:00100000:0.0:1785393908.574653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1785393908.574662:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:11328:x1872120807231616:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1785393908.574685:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393908.574705:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a35f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.574761:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.574773:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.574783:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393908.574834:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785393908.574838:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393908.574860:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.574904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a35f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7dc expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.575506:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7dc expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393908.575517:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:0.0:1785393908.575520:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393908.575523:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045000, rc 0) 00000100:00100000:0.0:1785393908.575594:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:11328:x1872120807231616:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 932us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393908.575603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1785393908.689829:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393908.689946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807231744 00000100:00100000:2.0:1785393908.689958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807231744 00000100:00100000:2.0:1785393908.690025:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1785393908.690036:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:11334:x1872120807231744:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393908.690077:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393908.690103:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a36d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690180:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690196:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690209:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690226:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690234:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690251:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690395:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690437:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393908.690478:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1785393908.690482:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393908.690508:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690521:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690528:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690535:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690542:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393908.690546:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690555:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690566:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:2.0:1785393908.690623:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393908.690629:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690645:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690659:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690666:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690671:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690675:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393908.690678:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690684:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690692:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93acc89f9e00) 00010000:00010000:2.0:1785393908.690693:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393908.690696:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690702:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a37b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690734:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7e3 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690748:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7e3 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.690760:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393908.690763:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785393908.690765:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0400, rc 0) 00000100:00100000:2.0:1785393908.690838:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:11334:x1872120807231744:12345-192.168.203.12@tcp:101:bash.0 Request processed in 804us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393908.690846:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1785393908.697765:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393908.702393:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232000 00000100:00100000:3.0:1785393908.702413:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232000 00000100:00100000:3.0:1785393908.702504:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:3.0:1785393908.702516:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+15:11334:x1872120807232000:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393908.702541:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393908.702566:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a389 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7ea expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702758:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702776:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702790:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702958:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702982:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.702996:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785393908.703695:0:10972:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1785393908.703861:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703877:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703886:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703924:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703931:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703938:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703944:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393908.703948:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703955:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703966:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:3.0:1785393908.703969:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393908.703974:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.703979:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a390 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785393908.703991:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5c58974 reply state 000000009647e7a0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393908.704005:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785393908.704048:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a389 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 18 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.704063:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 17 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.704070:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:3.0:1785393908.704072:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393908.704075:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0600, rc 0) 00000100:00100000:3.0:1785393908.704152:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11334:x1872120807232000:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1638us (6401us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1785393908.704160:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:3.0:1785393908.710824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393908.710930:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232128 00000100:00100000:2.0:1785393908.710947:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232128 00000100:00100000:2.0:1785393908.711014:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1785393908.711025:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1872120807232128:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:2.0:1785393908.711078:0:6631:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1785393908.711118:0:6631:0:(genops.c:1406:class_connect()) connect: client cdff80e6-0298-4ec3-bd74-9f3c38d2038e, cookie 0xcc9b96d8b362a3ac 00002000:00100000:2.0:1785393908.711135:0:6631:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cdff80e6-0298-4ec3-bd74-9f3c38d2038e/ffff93acc886d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00010000:00010000:1.0:1785393908.711162:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1785393908.711164:0:6631:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:1.0:1785393908.711182:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.711191:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.711198:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393908.711203:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.711211:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.711244:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd8302000) 00010000:00010000:1.0:1785393908.711247:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393908.711251:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.711257:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0400/0xcc9b96d8b362a397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1785393908.711643:0:6631:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785393908.711678:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acc8869800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785393908.712205:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2357:x1872120807232128:12345-192.168.203.12@tcp:8:bash.0 Request processed in 1179us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393908.712212:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1785393908.724028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393908.727764:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232256 00000100:00100000:2.0:1785393908.727783:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232256 00000100:00100000:2.0:1785393908.727885:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1785393908.727896:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:0:x1872120807232256:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393908.727938:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393908.727963:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7f1 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785393908.727993:0:6630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785393908.728016:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1785393908.728021:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393908.728032:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.728065:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 7 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393908.728081:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393908.728158:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:0:x1872120807232256:12345-192.168.203.12@tcp:101:bash.0 Request processed in 264us (4140us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393908.728166:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00080000:3.0:1785393908.728982:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393908.734063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393908.734603:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232384 00000100:00100000:1.0:1785393908.734612:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232384 00000100:00100000:1.0:1785393908.734669:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1785393908.734678:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:11334:x1872120807232384:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393908.734696:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393908.734713:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7f8 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.734741:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.734749:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393908.734753:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393908.734758:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.734786:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.734811:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393908.734825:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf79d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831365120:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393908.742102:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef480 going to sleep for 11 seconds 00000100:00100000:0.0:1785393908.742401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393908.743257:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf79d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831365120:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393908.743294:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393908.743314:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82baa00, rc 0) 00000100:00100000:1.0:1785393908.743368:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:11334:x1872120807232384:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8690us (9313us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393908.743377:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1785393908.743508:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232512 00000100:00100000:3.0:1785393908.743515:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232512 00010000:00010000:3.0:1785393908.743542:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393908.743594:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1785393908.743602:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807232512:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393908.743613:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393908.743632:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.743662:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.743682:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362a3b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f1 expref: 8 pid: 6630 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.743693:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393908.743697:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393908.743705:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.743715:0:6645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.743745:0:6645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393908.743757:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831365248:192.168.203.12@tcp:105: 00000100:00100000:3.0:1785393908.743798:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785393908.748531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393908.748563:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807232768 00000100:00100000:0.0:1785393908.748595:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807232768 00000100:00100000:0.0:1785393908.748643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1785393908.748653:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:11334:x1872120807232768:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1785393908.749621:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831365248:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785393908.749640:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393908.749681:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807232512:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 6079us (7284us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393908.749689:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1785393908.750648:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11334:x1872120807232768:12345-192.168.203.12@tcp:35:bash.0 Request processed in 1994us (2123us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1785393908.750657:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:0.0:1785393908.832094:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393908.914817:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393908.914922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807233024 00000100:00100000:3.0:1785393908.914931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807233024 00000100:00100000:3.0:1785393908.914990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:3.0:1785393908.914999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11344:x1872120807233024:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785393908.915022:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393908.915042:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a3c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd7ff expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393908.915422:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1785393908.915537:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a3c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ff expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.915552:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:3.0:1785393908.915555:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393908.915561:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a3c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ff expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393908.915615:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785393908.915678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11344:x1872120807233024:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 675us (863us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1785393908.915685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:2.0:1785393908.926794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393908.926876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807233280 00000100:00100000:0.0:1785393908.926891:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807233280 00000100:00100000:0.0:1785393908.926966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1785393908.926976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11344:x1872120807233280:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393908.927222:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11344:x1872120807233280:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 246us (436us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1785393908.927230:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1785393909.099759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.099850:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807233408 00000100:00100000:0.0:1785393909.099859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807233408 00000100:00100000:0.0:1785393909.099939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1785393909.099950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11350:x1872120807233408:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393909.099973:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393909.099992:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd806 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100051:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100064:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100075:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393909.100138:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1785393909.100142:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393909.100169:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100191:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd806 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100225:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd806 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.100233:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393909.100236:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785393909.100239:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044600, rc 0) 00000100:00100000:0.0:1785393909.100298:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:11350:x1872120807233408:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 350us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393909.100305:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00080000:3.0:1785393909.100789:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393909.123526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.123770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807233664 00000100:00100000:0.0:1785393909.123779:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807233664 00000100:00100000:0.0:1785393909.123833:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:0.0:1785393909.123842:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:11350:x1872120807233664:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393909.123859:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393909.123901:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd80d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.124003:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a3e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.124017:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.124027:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393909.124036:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785393909.124360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd80d expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.124377:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd80d expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.124385:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:0.0:1785393909.124389:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393909.124392:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045c00, rc 0) 00000100:00100000:0.0:1785393909.124450:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11350:x1872120807233664:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 609us (940us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1785393909.124458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:2.0:1785393909.131555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393909.131626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.131703:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807233920 00000100:00100000:0.0:1785393909.131712:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807233920 00000100:00100000:0.0:1785393909.131766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:0.0:1785393909.131774:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11350:x1872120807233920:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393909.131798:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393909.131815:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd814 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.131914:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.131927:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.131946:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393909.131977:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785393909.132093:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a3f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd814 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.132120:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd814 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.132127:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:0.0:1785393909.132130:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785393909.132132:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045800, rc 0) 00000100:00100000:0.0:1785393909.132407:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11350:x1872120807233920:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 632us (778us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1785393909.132414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:3.0:1785393909.132841:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234048 00000100:00100000:3.0:1785393909.132847:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234048 00000100:00100000:3.0:1785393909.132886:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1785393909.132894:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:2359:x1872120807234048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393909.132914:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393909.132928:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a3e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd80d expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.132948:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:3.0:1785393909.132952:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393909.132982:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:2359:x1872120807234048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 89us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393909.132988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1785393909.139347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.139551:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234176 00000100:00100000:0.0:1785393909.139561:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234176 00000100:00100000:0.0:1785393909.139631:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1785393909.139639:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd7e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807234176:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:0.0:1785393909.139710:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.139728:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.139735:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785393909.139739:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785393909.139743:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.139785:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.139797:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 7 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393909.139810:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8307:1872120831365376:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393909.139872:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785393909.142336:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8307:1872120831365376:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393909.142363:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393909.142851:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393909.142960:0:6637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234304 00000100:00100000:3.0:1785393909.142967:0:6637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234304 00002000:00100000:3.0:1785393909.143010:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93acf960ce00 x1872120807234304/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:120/0 lens 504/0 e 0 to 0 dl 1785393920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393909.143019:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf960ce00 with x1872120807234304 ext(0->12) 00010000:00010000:3.0:1785393909.143026:0:6637:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 8 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.143039:0:6637:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 8 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785393909.143055:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acf960ce00 00000100:00100000:3.0:1785393909.143079:0:6637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1785393909.143087:0:6637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807234304:12345-192.168.203.12@tcp:4:lfs.0 00000001:00100000:2.0:1785393909.286552:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000100:00100000:1.0:1785393909.287334:0:6637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2358:x1872120807234304:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 144239us (144477us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1785393909.287346:0:6637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:1.0:1785393909.287359:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93acf960ce00 x1872120807234304/t4294967305(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:120/0 lens 504/448 e 0 to 0 dl 1785393920 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785393909.287370:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf960ce00 with x1872120807234304 ext(0->12) 00010000:00010000:1.0:1785393909.287382:0:6637:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.287411:0:6637:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785393909.287419:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acf960ce00 00000100:00100000:1.0:1785393909.297518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393909.297675:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234432 00000100:00100000:3.0:1785393909.297685:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234432 00010000:00010000:3.0:1785393909.297722:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393909.297781:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1785393909.297790:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807234432:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393909.297805:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785393909.297824:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1785393909.297826:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785393907 00002000:00010000:3.0:1785393909.297828:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785393908 00002000:00010000:3.0:1785393909.297830:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785393907 00010000:00010000:3.0:1785393909.297836:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.297849:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.297872:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e93abab1/0xcc9b96d8b362a3ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7f8 expref: 9 pid: 6632 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.297889:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393909.297894:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393909.297899:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.297909:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.298099:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393909.298166:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807234432:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 377us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393909.298174:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:0.0:1785393909.310867:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.310885:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311013:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311025:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311034:0:8307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311048:0:8307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393909.311053:0:8307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311061:0:8307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311079:0:8307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.311086:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393909.311212:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd7e10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807234176:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 171569us (171869us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393909.311222:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1785393909.320788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.325857:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234688 00000100:00100000:0.0:1785393909.325870:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234688 00000100:00100000:0.0:1785393909.325925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1785393909.325934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd041450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11350:x1872120807234688:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1785393909.325988:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd814 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393909.326210:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1785393909.326244:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1785393909.326869:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1785393909.326913:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.326927:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 28 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.326936:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.326965:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 28 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.326978:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 28 pid: 10972 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393909.326991:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831365504:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393909.327072:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e840 going to sleep for 11 seconds 00000100:00100000:0.0:1785393909.333721:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393909.334518:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234816 00000100:00100000:1.0:1785393909.334527:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234816 00010000:00010000:1.0:1785393909.334564:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 29 pid: 10972 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393909.334627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1785393909.334636:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8529c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:2358:x1872120807234816:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393909.334648:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393909.334654:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 29 pid: 10972 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.334666:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 29 pid: 10972 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.334684:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:1.0:1785393909.334689:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.334698:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.334705:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.334733:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393909.334775:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8529c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:2358:x1872120807234816:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 141us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393909.334782:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:3.0:1785393909.341775:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a39e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ea expref: 28 pid: 10972 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393909.341797:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1872120831365504:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393909.341818:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.341827:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.341832:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785393909.341956:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1785393909.342129:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1785393909.342220:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aafb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831365632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785393909.342272:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393909.342404:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393909.348320:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831365632 00000100:00100000:2.0:1785393909.348334:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831365632 00000100:00100000:2.0:1785393909.348431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1785393909.348899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393909.349071:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831365632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393909.349207:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831365632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (6933us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393909.349214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785393909.349356:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aafb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831365632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1785393909.352165:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1785393909.352258:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831365760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785393909.352323:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393909.352358:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc872acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393909.352479:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831365760 00000100:00100000:1.0:1785393909.352486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831365760 00000100:00100000:1.0:1785393909.352535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785393909.352544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1872120831365760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785393909.352738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1872120831365760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 194us (413us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1785393909.352746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785393909.352873:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1872120831365760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1785393909.352924:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1785393909.352974:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.352983:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.352998:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.353003:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393909.353007:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.353014:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.353027:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:0.0:1785393909.353030:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1785393909.353033:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393909.353039:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a40e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785393909.353229:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1785393909.353360:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1785393909.353369:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441384798891ns, next at 442384797231ns, rc = 0 00000001:00080000:0.0:1785393909.353387:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1785393909.353420:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acd8302a00) 00010000:00010000:0.0:1785393909.353423:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785393909.353430:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a3f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd814 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393909.353531:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd041450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11350:x1872120807234688:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 27598us (32752us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1785393909.353547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000020:00080000:0.0:1785393909.353551:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1785393909.357333:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393909.357449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807234944 00000100:00100000:2.0:1785393909.357459:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807234944 00000100:00100000:2.0:1785393909.357508:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:2.0:1785393909.357517:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11350:x1872120807234944:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393909.357538:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393909.357558:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd81b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.357635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd81b expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.357648:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd81b expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.357664:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393909.357667:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785393909.357671:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1800, rc 0) 00000100:00100000:2.0:1785393909.357715:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11350:x1872120807234944:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 200us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393909.357722:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:3.0:1785393909.368216:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393909.368354:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807235200 00000100:00100000:2.0:1785393909.368363:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807235200 00000100:00100000:2.0:1785393909.368421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1785393909.368430:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11350:x1872120807235200:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393909.368680:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11350:x1872120807235200:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 250us (472us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1785393909.368687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1785393909.527406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393909.527538:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807235456 00000100:00100000:1.0:1785393909.527547:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807235456 00000100:00100000:1.0:1785393909.527621:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:1.0:1785393909.527631:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11360:x1872120807235456:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393909.527653:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393909.527671:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a41c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd822 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393909.527767:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1785393909.527862:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a41c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd822 expref: 35 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.527876:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:1.0:1785393909.527879:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393909.527883:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a41c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd822 expref: 35 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.527902:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba000, rc 0) 00000100:00100000:1.0:1785393909.527963:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11360:x1872120807235456:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 333us (565us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1785393909.527970:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:1.0:1785393909.531722:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393909.531816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807235584 00000100:00100000:2.0:1785393909.531825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807235584 00000100:00100000:2.0:1785393909.531872:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:2.0:1785393909.531881:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11360:x1872120807235584:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1785393909.531969:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.531985:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.531997:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532011:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532017:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532023:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532110:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532299:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532307:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393909.532347:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532359:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532366:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532372:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532378:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393909.532382:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532389:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532400:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393909.532403:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393909.532407:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532413:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a42a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532432:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532547:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532553:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532558:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393909.532561:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532567:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532650:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9f00) 00010000:00010000:2.0:1785393909.532653:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393909.532656:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532662:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532678:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532685:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532692:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532703:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393909.532707:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532714:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532722:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393909.532724:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393909.532727:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393909.532733:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393909.532788:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11360:x1872120807235584:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 908us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393909.532796:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:3.0:1785393909.534483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393909.534600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807235840 00000100:00100000:2.0:1785393909.534606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807235840 00000100:00100000:2.0:1785393909.534637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1785393909.534644:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11360:x1872120807235840:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393909.534818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11360:x1872120807235840:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 173us (339us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1785393909.534826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1785393909.616309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393909.616672:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807236096 00000100:00100000:1.0:1785393909.616681:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807236096 00000100:00100000:1.0:1785393909.616737:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:1.0:1785393909.616746:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11363:x1872120807236096:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393909.616769:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393909.616789:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a43f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd829 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616854:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616867:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616877:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616891:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616898:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.616921:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617032:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617042:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617056:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393909.617066:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1785393909.617334:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617342:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617348:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617354:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393909.617357:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617364:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617376:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393909.617378:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393909.617388:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617394:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617408:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617413:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617419:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617424:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82baa00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393909.617426:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617431:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617437:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc3c44200) 00010000:00010000:1.0:1785393909.617440:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393909.617442:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617448:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a44d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617487:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a43f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 38 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617516:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 37 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393909.617527:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:1.0:1785393909.617529:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393909.617532:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bbc00, rc 0) 00000100:00100000:1.0:1785393909.617740:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11363:x1872120807236096:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 994us (1437us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1785393909.617749:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:0.0:1785393909.632773:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393909.632845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807236224 00000100:00100000:3.0:1785393909.632854:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807236224 00000100:00100000:3.0:1785393909.632897:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:3.0:1785393909.632906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11363:x1872120807236224:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1785393909.632981:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.632997:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633007:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633031:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633038:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633055:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633061:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393909.633065:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633072:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633081:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393909.633084:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785393909.633088:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393909.633093:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393909.633175:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11363:x1872120807236224:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 270us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393909.633183:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:2.0:1785393909.637940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393909.638021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807236480 00000100:00100000:0.0:1785393909.638029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807236480 00000100:00100000:0.0:1785393909.638084:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1785393909.638093:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11363:x1872120807236480:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393909.638306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:11363:x1872120807236480:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 214us (374us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1785393909.638313:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:1.0:1785393909.855892:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393910.152415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.152599:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807236736 00000100:00100000:3.0:1785393910.152608:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807236736 00000100:00100000:3.0:1785393910.152666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:3.0:1785393910.152676:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:11394:x1872120807236736:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1785393910.152699:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393910.152728:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd830 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.152819:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.152832:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.152845:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393910.152855:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1785393910.152969:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd830 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.152987:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd830 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.152996:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393910.153010:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393910.153014:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393910.153114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11394:x1872120807236736:12345-192.168.203.12@tcp:101:cat.0 Request processed in 440us (718us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1785393910.153121:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:1.0:1785393910.177860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393910.177946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393910.178244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807236992 00000100:00100000:0.0:1785393910.178253:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807236992 00000100:00100000:0.0:1785393910.178317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1785393910.178327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11394:x1872120807236992:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1785393910.178642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:11394:x1872120807236992:12345-192.168.203.12@tcp:35:cat.0 Request processed in 316us (790us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1785393910.178650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1785393910.179008:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807237120 00000100:00100000:2.0:1785393910.179014:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807237120 00000100:00100000:2.0:1785393910.179068:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1785393910.179076:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:2358:x1872120807237120:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393910.179086:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393910.179116:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd830 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.179133:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393910.179138:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393910.179172:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:2358:x1872120807237120:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 97us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393910.179180:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785393910.271098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.271548:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807237376 00000100:00100000:3.0:1785393910.271559:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807237376 00000100:00100000:3.0:1785393910.271651:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1785393910.271660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11400:x1872120807237376:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1785393910.271683:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393910.271686:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785393910.271709:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a3d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd806 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.271821:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:3.0:1785393910.271825:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393910.271839:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a47e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd837 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.271941:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.271956:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 40 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.271965:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.271993:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 40 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.272017:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 40 pid: 10972 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393910.272031:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831365888:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393910.272691:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b600 going to sleep for 11 seconds 00000100:00100000:3.0:1785393910.282068:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831365888:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393910.282097:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393910.302634:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.302706:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807237504 00000100:00100000:3.0:1785393910.302724:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807237504 00010000:00010000:3.0:1785393910.302761:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 41 pid: 10972 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393910.302808:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1785393910.302817:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:2359:x1872120807237504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393910.302831:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393910.302837:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 41 pid: 10972 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302851:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 41 pid: 10972 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302872:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbc00/0xcc9b96d8b362a454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd829 expref: 41 pid: 10972 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302906:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393910.302922:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302933:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302940:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.302970:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393910.303021:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:2359:x1872120807237504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393910.303028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00010000:00010000:0.0:1785393910.303206:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.303215:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393910.303242:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785393910.303413:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a47e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.303429:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.303437:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:0.0:1785393910.303440:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785393910.303443:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0200, rc 0) 00000100:00100000:0.0:1785393910.303481:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11400:x1872120807237376:12345-192.168.203.12@tcp:101:dd.0 Request processed in 31822us (32390us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1785393910.303488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:1.0:1785393910.311602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.311636:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807237760 00000100:00100000:3.0:1785393910.311646:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807237760 00000100:00100000:3.0:1785393910.311701:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:3.0:1785393910.311721:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11400:x1872120807237760:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1785393910.311947:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.311963:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.311974:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785393910.312022:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1785393910.312045:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000370f4a49 reply state 00000000ed5b3a21 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393910.312062:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393910.312142:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:11400:x1872120807237760:12345-192.168.203.12@tcp:36:dd.0 Request processed in 432us (572us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1785393910.312149:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000020:00080000:3.0:1785393910.312153:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785393910.323544:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323560:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323567:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323611:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393910.323615:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323622:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323636:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393910.323638:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393910.323654:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.323660:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a493 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.881701:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393910.899991:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393910.902438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807237888 00000100:00100000:2.0:1785393910.902450:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807237888 00000100:00100000:2.0:1785393910.902513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:2.0:1785393910.902522:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+42:11414:x1872120807237888:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1785393910.902542:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393910.902561:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a49a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd83e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902649:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902661:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902670:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902681:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902687:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393910.902693:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785393910.914132:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1785393910.914151:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:0.0:1785393910.918176:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.918203:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.918211:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.918711:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.918729:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 39 pid: 5833 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393910.918765:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831366016:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393910.918872:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e3c0 going to sleep for 11 seconds 00000020:00080000:2.0:1785393910.919860:0:12261:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ace422b6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1785393910.919866:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acc7030d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ace422be40 00000020:00080000:2.0:1785393910.919869:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf75bd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acffadf400 00000001:00080000:2.0:1785393910.919882:0:12261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:3.0:1785393910.920252:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1785393910.920452:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1785393910.922421:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831366016:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393910.922446:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393910.926467:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.926902:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831366144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785393910.926952:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393910.927007:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366144 00000100:00100000:3.0:1785393910.927014:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366144 00000100:00100000:3.0:1785393910.927069:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785393910.927078:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831366144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785393910.927105:0:6631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1785393910.927135:0:6631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a6af2f3, atime: 0x6a6af2f4, ctime: 0x6a6af2f3, blocks: 0x1 00010000:00010000:3.0:1785393910.927143:0:6631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.927158:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1785393910.927163:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393910.927170:0:6631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.927184:0:6631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.927204:0:6631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.927211:0:6631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.927224:0:6631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785393910.927730:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1872120831366144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 652us (776us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785393910.927738:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:3.0:1785393910.927781:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf7e40380/2, rc 0, transno 4294967307 00000100:00100000:3.0:1785393910.927787:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831366144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785393910.927992:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807238144 00000100:00100000:2.0:1785393910.927997:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807238144 00000100:00100000:2.0:1785393910.928040:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1785393910.928047:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:5580:x1872120807238144:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1785393910.928362:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:5580:x1872120807238144:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 315us (1903us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1785393910.928369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00010000:00010000:0.0:1785393910.932878:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785393910.932890:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.932902:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785393910.932907:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.932918:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.932938:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.932945:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362a4b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.932972:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393910.932974:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393910.932975:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393910.934698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393910.934774:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807238272 00000100:00100000:3.0:1785393910.934782:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807238272 00010000:00010000:3.0:1785393910.934817:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 19 pid: 5833 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393910.934854:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1785393910.934862:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2359:x1872120807238272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393910.934877:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393910.934884:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 19 pid: 5833 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.934897:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 19 pid: 5833 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.934952:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a485 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd837 expref: 19 pid: 5833 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.934968:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393910.934973:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.934981:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.934989:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393910.935018:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393910.935068:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2359:x1872120807238272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 205us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393910.935075:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00010000:00010000:0.0:1785393910.936451:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936463:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393910.936515:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1785393910.936519:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393910.936540:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936552:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936563:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936585:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936592:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936599:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393910.936603:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936610:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936621:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393910.936624:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393910.936628:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a4a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936657:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936664:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936670:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936675:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393910.936679:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936685:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936693:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9a00) 00010000:00010000:0.0:1785393910.936696:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393910.936699:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a4a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936741:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a49a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd83e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936755:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd83e expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393910.936773:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:0.0:1785393910.936776:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393910.936778:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393910.936819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:11414:x1872120807237888:12345-192.168.203.12@tcp:101:stat.0 Request processed in 34297us (36836us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393910.936827:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:1.0:1785393911.083782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393911.083883:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807238528 00000100:00100000:3.0:1785393911.083892:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807238528 00000100:00100000:3.0:1785393911.083972:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:3.0:1785393911.083982:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:11420:x1872120807238528:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:3.0:1785393911.084030:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393911.084054:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a4af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd83e expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.084071:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393911.084076:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393911.084284:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.084296:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.084305:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785393911.084347:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1785393911.084367:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001c9b180 reply state 000000007f699e5a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393911.084375:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393911.084457:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11420:x1872120807238528:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 476us (682us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1785393911.084464:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000020:00080000:3.0:1785393911.084467:0:10972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1785393911.085087:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785393911.085762:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085772:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085779:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085785:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393911.085789:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085805:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085816:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393911.085819:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393911.085822:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.085828:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a4bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393911.328735:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831366528:0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.328798:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393911.328850:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785393911.328866:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831366400:0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.328904:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393911.328918:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831366912:0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.328937:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393911.328971:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366912 00000100:00100000:1.0:1785393911.328978:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366912 00000100:00100000:1.0:1785393911.329024:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785393911.329033:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831366912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.329076:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831366912:12345-0@lo:400:kworker.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393911.329083:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785393911.329118:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831366912:0@lo:400:kworker.0 00000100:00100000:2.0:1785393911.329225:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831366272:0@lo:400:kworker.0 00000100:00100000:2.0:1785393911.329274:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393911.329301:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831366784:0@lo:400:kworker.0 00000100:00100000:2.0:1785393911.329320:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393911.329335:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785393911.329339:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831366656:0@lo:400:kworker.0 00000100:00100000:2.0:1785393911.329356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393911.329582:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366528 00000100:00100000:3.0:1785393911.329587:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366528 00000100:00100000:3.0:1785393911.329613:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366400 00000100:00100000:3.0:1785393911.329616:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366400 00000100:00100000:3.0:1785393911.329626:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366784 00000100:00100000:3.0:1785393911.329629:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366784 00000100:00100000:3.0:1785393911.329641:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1785393911.329647:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329692:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831366528:12345-0@lo:400:kworker.0 Request processed in 45us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.329698:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1785393911.329710:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1785393911.329716:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831366400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329749:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831366400:12345-0@lo:400:kworker.0 Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.329755:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1785393911.329765:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1785393911.329770:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831366784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329798:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831366784:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.329804:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1785393911.329825:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831366784:0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329844:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831366400:0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329852:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831366528:0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329881:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366656 00000100:00100000:3.0:1785393911.329884:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366656 00000100:00100000:3.0:1785393911.329906:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785393911.329912:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831366656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393911.329942:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831366656:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.329949:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785393911.329970:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831366656:0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.330153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831366272 00000100:00100000:1.0:1785393911.330158:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831366272 00000100:00100000:1.0:1785393911.330188:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1785393911.330195:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831366272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.330242:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831366272:12345-0@lo:400:kworker.0 Request processed in 40us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393911.330254:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:0.0:1785393911.330476:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393911.330486:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393911.330488:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393911.332280:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831366272:0@lo:400:kworker.0 00000100:00100000:1.0:1785393911.371215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393911.373161:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807238656 00000100:00100000:3.0:1785393911.373175:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807238656 00000100:00100000:3.0:1785393911.373280:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:3.0:1785393911.373291:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11434:x1872120807238656:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:3.0:1785393911.373338:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393911.373365:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a4c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd845 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373451:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373467:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373481:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373496:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373503:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373510:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373922:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373933:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.373940:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393911.373981:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1785393911.373991:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393911.374017:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374029:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374038:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374044:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374050:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374057:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393911.374061:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374068:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374080:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:3.0:1785393911.374084:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393911.374089:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374095:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a4cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374107:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374122:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374128:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374133:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393911.374136:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374143:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374151:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd8302d00) 00010000:00010000:3.0:1785393911.374153:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393911.374156:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374162:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374195:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a4c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 20 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374208:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 19 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.374215:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393911.374217:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393911.374225:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1000, rc 0) 00000100:00100000:3.0:1785393911.374313:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad008f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11434:x1872120807238656:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1024us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.374321:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:1.0:1785393911.543825:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393911.544015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807238912 00000100:00100000:0.0:1785393911.544029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807238912 00000100:00100000:0.0:1785393911.544109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1785393911.544121:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11444:x1872120807238912:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393911.544150:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393911.544175:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a4e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd84c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393911.544519:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1785393911.544725:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a4e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd84c expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393911.544959:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:0.0:1785393911.544964:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785393911.544971:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a4e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd84c expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393911.545000:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045e00, rc 0) 00000100:00100000:0.0:1785393911.545073:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11444:x1872120807238912:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 955us (1263us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1785393911.545081:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:1.0:1785393911.549694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393911.549804:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807239168 00000100:00100000:2.0:1785393911.549814:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807239168 00000100:00100000:2.0:1785393911.549886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1785393911.549897:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd042450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11444:x1872120807239168:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393911.550649:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd042450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:11444:x1872120807239168:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 751us (964us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1785393911.550659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1785393911.682017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393911.682345:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807239424 00000100:00100000:3.0:1785393911.682360:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807239424 00000100:00100000:3.0:1785393911.682439:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:3.0:1785393911.682451:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:11450:x1872120807239424:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393911.682487:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393911.682514:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a4ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd853 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.682702:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.682720:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 22 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.682730:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.682782:0:10972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 22 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.682799:0:10972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 22 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393911.682815:0:10972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831367040:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393911.682949:0:10972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785393911.687457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393911.688043:0:10972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831367040:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393911.688080:0:10972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393911.690689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807239552 00000100:00100000:2.0:1785393911.690727:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807239552 00010000:00010000:2.0:1785393911.690841:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 23 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393911.690894:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1785393911.690905:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:2358:x1872120807239552:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393911.690923:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393911.690932:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 23 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.690946:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 23 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.690973:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a4d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd845 expref: 23 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.690992:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393911.690997:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.691008:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.691017:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.691210:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393911.691289:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2358:x1872120807239552:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 385us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393911.691307:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00010000:00010000:3.0:1785393911.697751:0:10972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.697863:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393911.697998:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1785393911.698357:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a4ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 23 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.698383:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 22 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.698394:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393911.698397:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785393911.698402:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1a00, rc 0) 00000100:00100000:3.0:1785393911.698562:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:11450:x1872120807239424:12345-192.168.203.12@tcp:101:bash.0 Request processed in 16111us (16556us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1785393911.698598:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:1.0:1785393911.708724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393911.715378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807239808 00000100:00100000:0.0:1785393911.715397:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807239808 00000100:00100000:0.0:1785393911.716316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:0.0:1785393911.716332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:11450:x1872120807239808:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1785393911.716683:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393911.716704:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393911.716717:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393911.716918:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1785393911.716951:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039a99ae7 reply state 0000000073a35fa1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393911.716960:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393911.717085:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11450:x1872120807239808:12345-192.168.203.12@tcp:36:bash.0 Request processed in 758us (8372us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1785393911.718511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000020:00080000:0.0:1785393911.718523:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785393911.726209:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726231:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726274:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726281:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393911.726287:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726296:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726316:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393911.726320:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393911.726325:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.726332:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a503 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393911.731692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393911.732318:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807239936 00000100:00100000:2.0:1785393911.732332:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807239936 00000100:00100000:2.0:1785393911.732400:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:2.0:1785393911.732413:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11450:x1872120807239936:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393911.732448:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393911.732476:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a50a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd85a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.732600:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.732619:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 25 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.732629:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.732668:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 25 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.732682:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 25 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393911.732697:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831367168:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393911.732795:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd4908f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785393911.744171:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831367168:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393911.744226:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393911.747088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393911.747248:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807240064 00000100:00100000:3.0:1785393911.747259:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807240064 00010000:00010000:3.0:1785393911.747315:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 26 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393911.747358:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1785393911.747369:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:2359:x1872120807240064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393911.747385:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393911.747392:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 26 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747416:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 26 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747442:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a4f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd853 expref: 26 pid: 10972 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747463:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:3.0:1785393911.747469:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747481:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747490:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393911.747526:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393911.747639:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:2359:x1872120807240064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 270us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.747647:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00010000:00010000:2.0:1785393911.747764:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.747773:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393911.747827:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785393911.747831:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393911.747854:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.747889:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a50a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd85a expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.747908:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd85a expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.747915:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393911.747918:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393911.747920:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0e00, rc 0) 00000100:00100000:2.0:1785393911.747948:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11450:x1872120807239936:12345-192.168.203.12@tcp:101:bash.0 Request processed in 15539us (16268us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393911.747955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:3.0:1785393911.752723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393911.752808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807240320 00000100:00100000:1.0:1785393911.752820:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807240320 00000100:00100000:1.0:1785393911.752890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1785393911.752902:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11450:x1872120807240320:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1785393911.753416:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11450:x1872120807240320:12345-192.168.203.12@tcp:35:bash.0 Request processed in 515us (704us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1785393911.753425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1785393911.839900:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831367296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393911.840011:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393911.840227:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831367296 00000100:00100000:3.0:1785393911.840236:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831367296 00000100:00100000:3.0:1785393911.840315:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1785393911.840326:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831367296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393911.840372:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393911.840436:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831367296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393911.840461:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785393911.840759:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831367296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393911.904517:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393911.918084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393911.918284:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807240576 00000100:00100000:2.0:1785393911.918298:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807240576 00000100:00100000:2.0:1785393911.918373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1785393911.918385:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11460:x1872120807240576:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393911.918463:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393911.918492:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd861 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393911.918855:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1785393911.919072:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a518 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd861 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.919090:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:2.0:1785393911.919106:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393911.919112:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd861 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393911.919129:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0000, rc 0) 00000100:00100000:2.0:1785393911.920282:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11460:x1872120807240576:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1895us (2207us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1785393911.920292:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:3.0:1785393911.931696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393911.931791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807240704 00000100:00100000:1.0:1785393911.931804:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807240704 00000100:00100000:1.0:1785393911.931879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1785393911.931891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11460:x1872120807240704:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1785393911.931994:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932014:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932028:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932046:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932078:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932086:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932810:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932822:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932830:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393911.932879:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932893:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932900:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.932908:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933078:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82baa00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393911.933083:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933101:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933121:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393911.933125:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393911.933130:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933951:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a526 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933969:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933975:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933981:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933985:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393911.933988:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.933995:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934003:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc3c44200) 00010000:00010000:1.0:1785393911.934005:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393911.934009:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934015:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a52d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934042:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934048:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934054:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934058:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393911.934061:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934067:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934073:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:1.0:1785393911.934076:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393911.934079:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393911.934084:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393911.934304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11460:x1872120807240704:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 2413us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393911.934313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1785393911.940368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393911.940464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807240960 00000100:00100000:0.0:1785393911.940476:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807240960 00000100:00100000:0.0:1785393911.940563:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1785393911.940607:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11460:x1872120807240960:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393911.941145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:11460:x1872120807240960:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 532us (782us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1785393911.941154:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1785393912.049562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393912.049728:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807241216 00000100:00100000:0.0:1785393912.049742:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807241216 00000100:00100000:0.0:1785393912.049818:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:0.0:1785393912.049831:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:11463:x1872120807241216:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393912.049866:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393912.049893:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a53b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd868 expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050003:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050020:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050035:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050052:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050060:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393912.050068:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.050986:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.050999:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051017:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393912.051031:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785393912.051315:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051325:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051332:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051339:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393912.051345:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051354:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051369:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393912.051372:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393912.051378:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051385:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051401:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051408:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051422:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051440:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393912.051444:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051451:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051460:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd96a4100) 00010000:00010000:1.0:1785393912.051463:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393912.051466:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051473:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051529:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a53b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd868 expref: 30 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051547:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd868 expref: 29 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393912.051556:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:1.0:1785393912.051558:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393912.051561:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb400, rc 0) 00000100:00100000:1.0:1785393912.051685:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11463:x1872120807241216:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1856us (2138us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1785393912.051705:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1785393912.060085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.060272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807241344 00000100:00100000:2.0:1785393912.060285:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807241344 00000100:00100000:2.0:1785393912.060357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:2.0:1785393912.060368:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11463:x1872120807241344:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1785393912.060456:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060477:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060492:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060545:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060552:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060560:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060567:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393912.060607:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060617:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060630:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393912.060634:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393912.060638:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.060644:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a55e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393912.060729:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11463:x1872120807241344:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 363us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393912.060738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:3.0:1785393912.064682:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.064818:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807241472 00000100:00100000:2.0:1785393912.064830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807241472 00000100:00100000:2.0:1785393912.064908:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:2.0:1785393912.064939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:2359:x1872120807241472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393912.064962:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393912.064994:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb400/0xcc9b96d8b362a550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd868 expref: 29 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.065016:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393912.065022:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393912.065102:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:2359:x1872120807241472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 154us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393912.065111:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1785393912.080330:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393912.080437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807241728 00000100:00100000:0.0:1785393912.080449:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807241728 00000100:00100000:0.0:1785393912.080515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1785393912.080527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11463:x1872120807241728:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393912.080854:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11463:x1872120807241728:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 328us (538us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1785393912.080862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1785393912.353455:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831367424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393912.353549:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393912.353953:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831367424 00000100:00100000:3.0:1785393912.353964:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831367424 00000100:00100000:3.0:1785393912.354053:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785393912.354066:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831367424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393912.354301:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393912.354436:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831367424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 372us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393912.354444:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1785393912.367460:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831367424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785393912.428681:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.429567:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807241984 00000100:00100000:2.0:1785393912.429618:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807241984 00000100:00100000:2.0:1785393912.429703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:2.0:1785393912.429713:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11481:x1872120807241984:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1785393912.429747:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393912.429780:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd86f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.430060:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a56c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.430183:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a56c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.430218:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a56c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393912.430289:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1785393912.431008:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd86f expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.431193:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a56c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd86f expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.431204:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393912.431207:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1785393912.431217:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1a00, rc 0) 00000100:00100000:2.0:1785393912.431321:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11481:x1872120807241984:12345-192.168.203.12@tcp:101:cat.0 Request processed in 1609us (2653us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1785393912.431329:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:3.0:1785393912.465371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.466197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807242112 00000100:00100000:2.0:1785393912.466234:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807242112 00000100:00100000:2.0:1785393912.466401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:2.0:1785393912.466414:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11482:x1872120807242112:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393912.466476:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393912.466505:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a57a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd876 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.466703:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.466720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.466735:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393912.466996:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1785393912.467001:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393912.467133:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.467167:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a57a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd876 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.467189:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd876 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.467199:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393912.467202:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785393912.467206:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393912.467301:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11482:x1872120807242112:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 889us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393912.467310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:3.0:1785393912.486200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393912.486378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807242496 00000100:00100000:0.0:1785393912.486411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807242496 00000100:00100000:0.0:1785393912.486741:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1785393912.486754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11482:x1872120807242496:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393912.487667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11482:x1872120807242496:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 913us (1480us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1785393912.487677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1785393912.501358:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.501713:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807242624 00000100:00100000:2.0:1785393912.501734:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807242624 00000100:00100000:2.0:1785393912.501822:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1785393912.501834:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11482:x1872120807242624:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:2.0:1785393912.501854:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1785393912.501885:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd85a expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.501916:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a56c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd86f expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.501958:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd81b expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.501969:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393912.501984:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393912.502057:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:11482:x1872120807242624:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 225us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393912.502066:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1785393912.511871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.512067:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807242752 00000100:00100000:2.0:1785393912.512101:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807242752 00000100:00100000:2.0:1785393912.512276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1785393912.512289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:11482:x1872120807242752:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:2.0:1785393912.512861:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.512883:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.512899:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785393912.515063:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1785393912.530065:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:11482:x1872120807242752:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 17764us (18192us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393912.530081:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:3.0:1785393912.609336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393912.618686:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807242880 00000100:00100000:2.0:1785393912.618705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807242880 00000100:00100000:2.0:1785393912.618802:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:2.0:1785393912.618814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+30:11484:x1872120807242880:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393912.618842:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393912.618883:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a58f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd87d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.618966:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.619002:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.619517:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.619540:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.619548:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.619555:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624542:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624585:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624614:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393912.624670:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785393912.624688:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393912.624712:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624751:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624761:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624781:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624788:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624793:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393912.624798:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624807:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624820:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393912.624871:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393912.624901:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624908:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624921:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624926:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624938:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624942:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393912.624945:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624949:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624970:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393912.624972:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393912.624975:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.624980:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a59d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.625139:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a58f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.625221:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393912.625243:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:2.0:1785393912.625246:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785393912.625248:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:2.0:1785393912.625397:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11484:x1872120807242880:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 6583us (16075us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393912.625419:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00010000:00010000:0.0:1785393912.930961:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393913.040334:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.040382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.040424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.040454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.040489:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243008 00000100:00100000:0.0:1785393913.040501:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243008 00000100:00100000:0.0:1785393913.040597:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 319 00000100:00100000:0.0:1785393913.040609:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807243008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393913.040696:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd04f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807243008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.040703:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 319 00000100:00100000:0.0:1785393913.040740:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243264 00000100:00100000:0.0:1785393913.040744:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243264 00000100:00100000:0.0:1785393913.040783:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243136 00000100:00100000:0.0:1785393913.040786:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243136 00000100:00100000:0.0:1785393913.040810:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1785393913.040816:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807243264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393913.040845:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807243264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.040852:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:0.0:1785393913.040864:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1785393913.040870:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807243136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393913.040895:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807243136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.040901:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1785393913.041020:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243392 00000100:00100000:0.0:1785393913.041024:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243392 00000100:00100000:0.0:1785393913.041066:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:0.0:1785393913.041073:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807243392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393913.042228:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2358:x1872120807243392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1153us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.042245:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00080000:0.0:1785393913.043201:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785393913.043207:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393913.043209:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1785393913.184182:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393913.184194:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393913.184247:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1785393913.184264:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785393913.184421:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831367552:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785393913.184548:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e780 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.217269:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831367552:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785393913.219274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393913.219943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243520 00000100:00100000:3.0:1785393913.219968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243520 00000100:00100000:3.0:1785393913.220032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:3.0:1785393913.220041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11495:x1872120807243520:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785393913.220078:0:5833:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1785393913.220228:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393913.231483:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11495:x1872120807243520:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 11422us (12194us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393913.231502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:2.0:1785393913.272516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.272636:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243648 00000100:00100000:0.0:1785393913.272651:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243648 00000100:00100000:0.0:1785393913.272729:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1785393913.272741:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11495:x1872120807243648:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785393913.272838:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272858:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272874:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272890:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272897:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272924:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272956:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272963:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.272969:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393913.273013:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1785393913.273017:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393913.273031:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273043:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273050:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273058:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273065:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393913.273071:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273079:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273245:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:0.0:1785393913.273248:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393913.273294:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273302:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a5ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273318:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273325:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273332:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273337:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393913.273340:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273346:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273355:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93acd96a4000) 00010000:00010000:0.0:1785393913.273357:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393913.273360:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273366:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a5b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273393:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273400:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273405:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273410:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393913.273413:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273420:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273428:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:0.0:1785393913.273430:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393913.273434:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.273440:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a5b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393913.273608:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11495:x1872120807243648:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 832us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.273617:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1785393913.305910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.305960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807243904 00000100:00100000:1.0:1785393913.305972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807243904 00000100:00100000:1.0:1785393913.306043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1785393913.306056:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11495:x1872120807243904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.306099:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393913.306127:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a5c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306266:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306304:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393913.306352:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785393913.306494:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306503:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306510:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306534:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82baa00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393913.306539:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306547:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306560:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:1.0:1785393913.306562:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393913.306567:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306599:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306645:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a5c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd884 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306655:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:1.0:1785393913.306657:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393913.306661:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a5c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd884 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.306669:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba000, rc 0) 00000100:00100000:1.0:1785393913.306729:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807243904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 676us (833us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1785393913.306736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1785393913.312794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.314294:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807244032 00000100:00100000:2.0:1785393913.314312:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807244032 00000100:00100000:2.0:1785393913.314395:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1785393913.314409:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807244032:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1785393913.314459:0:5832:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785393913.314615:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807244032:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 208us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393913.314623:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:2.0:1785393913.326632:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393913.330328:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807244288 00000100:00100000:3.0:1785393913.330346:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807244288 00000100:00100000:3.0:1785393913.330415:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:3.0:1785393913.330427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807244288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393913.330455:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393913.330460:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785393913.330492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd876 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.330526:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:3.0:1785393913.330531:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393913.330546:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a5d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd88b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785393913.332604:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1785393913.332891:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.332909:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.332933:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.332999:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a5d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd88b expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.333015:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd88b expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.333024:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acd8302d00) 00010000:00010000:3.0:1785393913.333028:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393913.333030:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393913.337248:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11495:x1872120807244288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 6808us (10614us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1785393913.337275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1785393913.350383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.350506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807244544 00000100:00100000:2.0:1785393913.350520:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807244544 00000100:00100000:2.0:1785393913.350624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:2.0:1785393913.350637:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11495:x1872120807244544:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785393913.350718:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393913.350751:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd88b expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350770:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acd8302d00) 00010000:00010000:2.0:1785393913.350782:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785393913.350810:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350827:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350853:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350870:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350877:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.350885:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351425:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351435:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351441:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351448:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393913.351452:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351461:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351472:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393913.351475:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393913.351479:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a5ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351505:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351511:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351517:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351523:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393913.351526:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351532:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351540:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbdfb1f2 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393913.351543:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393913.351546:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.351551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a5f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbdfb1f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.352300:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807244544:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1662us (1926us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785393913.352311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:0.0:1785393913.359782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.379385:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807244672 00000100:00100000:1.0:1785393913.379406:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807244672 00000100:00100000:1.0:1785393913.379497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:1.0:1785393913.379511:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11495:x1872120807244672:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.379539:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393913.379587:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a5f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd892 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379634:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379650:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379664:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a5f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379810:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.379819:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.379823:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785393913.379826:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82baa00, rc 0) 00000100:00100000:1.0:1785393913.379909:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11495:x1872120807244672:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 401us (20138us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.379926:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:1.0:1785393913.384368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.384548:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807244928 00000100:00100000:2.0:1785393913.384561:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807244928 00000100:00100000:2.0:1785393913.384644:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:2.0:1785393913.384655:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+33:11495:x1872120807244928:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785393913.384753:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.384772:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.384786:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785393913.385221:0:10972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1785393913.385233:0:10972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445416662730ns, next at 446416659965ns, rc = 0 00000004:00010000:2.0:1785393913.385354:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000400ad950 reply state 00000000e608aec5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.385364:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785393913.385479:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11495:x1872120807244928:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 825us (1122us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1785393913.385487:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:1.0:1785393913.388441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1785393913.388760:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388773:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388780:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388798:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393913.388804:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388813:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388830:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393913.388833:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785393913.388838:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.388844:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a606 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393913.388947:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245056 00000100:00100000:0.0:1785393913.388957:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245056 00000100:00100000:0.0:1785393913.390000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:0.0:1785393913.390013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11495:x1872120807245056:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393913.390044:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393913.390065:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd899 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.390160:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.390176:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.390199:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393913.390202:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393913.390205:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045e00, rc 0) 00000100:00100000:0.0:1785393913.390283:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11495:x1872120807245056:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 273us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.390291:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:1.0:1785393913.403462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393913.404285:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245184 00000100:00100000:3.0:1785393913.404298:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245184 00000100:00100000:3.0:1785393913.404363:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1785393913.404375:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807245184:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1785393913.404778:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807245184:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 405us (1328us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1785393913.404786:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1785393913.415521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.419519:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245440 00000100:00100000:0.0:1785393913.419540:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245440 00000100:00100000:0.0:1785393913.419648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1785393913.420151:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11495:x1872120807245440:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785393913.420472:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:11495:x1872120807245440:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 812us (4963us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1785393913.428848:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.431136:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245696 00000100:00100000:2.0:1785393913.431152:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245696 00000100:00100000:2.0:1785393913.431230:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1785393913.431241:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807245696:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785393913.431398:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807245696:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 157us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393913.431406:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:0.0:1785393913.437630:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1785393913.440219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.440366:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245824 00000100:00100000:1.0:1785393913.440379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245824 00000100:00100000:1.0:1785393913.440453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:1.0:1785393913.440464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:11495:x1872120807245824:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.440490:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393913.440515:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a614 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8a0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440619:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440636:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440648:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393913.440694:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785393913.440718:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440749:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a614 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a0 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440789:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a0 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.440799:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.440803:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785393913.440807:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bbe00, rc 0) 00000100:00100000:1.0:1785393913.440884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807245824:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 421us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.440891:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:2.0:1785393913.457231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.457324:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807245952 00000100:00100000:0.0:1785393913.457355:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807245952 00000100:00100000:0.0:1785393913.457430:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1785393913.457442:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807245952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393913.457467:0:6631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393913.457494:0:6631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8a7 expref: -99 pid: 6631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393913.457526:0:6631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6af2f8, blocks: 0x1 00010000:00010000:0.0:1785393913.457551:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:0.0:1785393913.457556:0:6631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393913.457566:0:6631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 8 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.457622:0:6631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 8 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.457640:0:6631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044600, rc 0) 00000100:00100000:0.0:1785393913.457701:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807245952:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 261us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.457711:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1785393913.471082:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.471165:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246208 00000100:00100000:2.0:1785393913.471181:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246208 00000100:00100000:2.0:1785393913.471262:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:2.0:1785393913.471284:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807246208:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785393913.471431:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807246208:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 149us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393913.471439:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:2.0:1785393913.479689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393913.479772:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246336 00000100:00100000:3.0:1785393913.479787:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246336 00000100:00100000:3.0:1785393913.479864:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1785393913.479898:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:11495:x1872120807246336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785393913.479918:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393913.479935:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8ae expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.479979:0:6630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 9 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.479988:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393913.479992:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393913.479997:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 9 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.480031:0:6630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 9 pid: 6631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.480046:0:6630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 9 pid: 6631 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393913.480059:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831367680:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393913.480151:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.483088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393913.483101:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831367680:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393913.483138:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246464 00000100:00100000:3.0:1785393913.483145:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246464 00010000:00010000:0.0:1785393913.483158:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 10 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483180:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 10 pid: 6631 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.483184:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1a00, rc 0) 00000100:00100000:3.0:1785393913.483249:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1785393913.483268:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807246464:12345-192.168.203.12@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1785393913.483280:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:11495:x1872120807246336:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3392us (3601us total) trans 0 rc 0/0 00010000:00010000:3.0:1785393913.483284:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1785393913.483303:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:3.0:1785393913.483311:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 10 pid: 6631 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483330:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 9 pid: 6631 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483354:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb330c0/0xcc9b96d8b362a622 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a7 expref: 9 pid: 6631 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483371:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393913.483376:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393913.483384:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483395:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.483429:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393913.483441:0:5816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1872120831367808:192.168.203.12@tcp:105: 00000100:00100000:3.0:1785393913.483517:0:5816:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.496199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393913.496241:0:6635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246592 00000100:00100000:3.0:1785393913.496249:0:6635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246592 00000100:00100000:0.0:1785393913.496307:0:5816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1872120831367808:192.168.203.12@tcp:105: 00002000:00100000:3.0:1785393913.496312:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93acf8aafb80 x1872120807246592/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:124/0 lens 504/0 e 0 to 0 dl 1785393924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393913.496333:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf8aafb80 with x1872120807246592 ext(0->8) 00002000:00010000:3.0:1785393913.496339:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf8aafb80 00010000:00010000:0.0:1785393913.496363:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393913.496372:0:6635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1785393913.496396:0:6635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807246592:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1785393913.496446:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807246464:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 13177us (13364us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393913.496458:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1785393913.496864:0:6635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807246592:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 480us (671us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1785393913.496873:0:6635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:3.0:1785393913.496880:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93acf8aafb80 x1872120807246592/t4294967314(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:124/0 lens 504/448 e 0 to 0 dl 1785393924 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393913.497080:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf8aafb80 with x1872120807246592 ext(0->8) 00002000:00010000:3.0:1785393913.497086:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf8aafb80 00000100:00100000:1.0:1785393913.523876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.523919:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246720 00000100:00100000:1.0:1785393913.523931:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246720 00000100:00100000:1.0:1785393913.523995:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1785393913.524007:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807246720:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1785393913.649039:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11495:x1872120807246720:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 125019us (125159us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.649057:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000001:00080000:1.0:1785393913.649272:0:12261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1785393913.649317:0:12261:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1785393913.649368:0:12261:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1785393913.649593:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393913.649613:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831367936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1785393913.649685:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393913.649806:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831367936 00000100:00100000:1.0:1785393913.649816:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831367936 00000020:00080000:3.0:1785393913.650050:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1785393913.650067:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1785393913.653717:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785393913.653736:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831367936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1785393913.654046:0:6632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785393913.654074:0:6632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785393912 00002000:00010000:1.0:1785393913.654077:0:6632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785393913.654080:0:6632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785393912 -> 1785393912 00002000:00010000:1.0:1785393913.654110:0:6632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785393913.654226:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831367936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 495us (4539us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1785393913.654239:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1785393913.654332:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf960d880/2, rc 0, transno 4294967315 00000100:00100000:1.0:1785393913.654340:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831367936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785393913.659268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.661200:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807246848 00000100:00100000:1.0:1785393913.661216:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807246848 00000100:00100000:1.0:1785393913.661303:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1785393913.661316:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2358:x1872120807246848:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1785393913.666170:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1785393913.749001:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1785393913.749029:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1785393913.749090:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807246848:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 87768us (89834us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.749102:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1785393913.759796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.762643:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247104 00000100:00100000:2.0:1785393913.762660:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247104 00000100:00100000:2.0:1785393913.762751:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:2.0:1785393913.762769:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11495:x1872120807247104:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.762934:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393913.762969:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bbe00/0xcc9b96d8b362a61b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8a0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.762988:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.762992:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393913.763021:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.763035:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.763057:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785393913.763304:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a3fef73 reply state 00000000126f40fc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.763314:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785393913.763421:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11495:x1872120807247104:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 653us (3634us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1785393913.763430:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00010000:00010000:2.0:1785393913.773643:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773659:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773667:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773673:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393913.773678:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773686:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773722:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393913.773726:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393913.773731:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.773737:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba000/0xcc9b96d8b362a630 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393913.779926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.780216:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247232 00000100:00100000:1.0:1785393913.780229:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247232 00000100:00100000:1.0:1785393913.780304:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1785393913.780316:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807247232:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785393913.780642:0:6632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1785393913.780649:0:6632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1785393912 -> 1785393910 00002000:00010000:1.0:1785393913.780652:0:6632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785393908 00002000:00010000:1.0:1785393913.780654:0:6632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785393912 -> 1785393910 00002000:00010000:1.0:1785393913.780657:0:6632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785393913.780724:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807247232:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 411us (810us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1785393913.780732:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1785393913.787857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.787945:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247488 00000100:00100000:1.0:1785393913.787954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247488 00000100:00100000:1.0:1785393913.788012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:1.0:1785393913.788023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11495:x1872120807247488:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.788098:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.788114:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.788123:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.788155:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.788170:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 18 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.788184:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831368064:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393913.788285:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1785393913.796818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.796872:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247616 00000100:00100000:2.0:1785393913.796873:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831368064:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393913.796880:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247616 00010000:00010000:2.0:1785393913.796901:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.796917:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.796951:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1785393913.796960:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2358:x1872120807247616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393913.796973:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393913.796980:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797022:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797044:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd892 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797059:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.797064:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797073:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797086:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.797138:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393913.797195:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2358:x1872120807247616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 235us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.797203:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00010000:00010000:3.0:1785393913.799116:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799127:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799164:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799171:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799178:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799184:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bac00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393913.799188:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799196:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:3.0:1785393913.799211:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1785393913.799215:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393913.799221:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bac00/0xcc9b96d8b362a637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393913.799297:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:11495:x1872120807247488:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 11273us (11446us total) trans 0 rc -22/-22 00000100:00100000:3.0:1785393913.799306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:0.0:1785393913.810677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.810810:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247744 00000100:00100000:1.0:1785393913.810820:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247744 00000100:00100000:1.0:1785393913.810876:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1785393913.810886:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807247744:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.810929:0:6630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.810962:0:6630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.810971:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393913.810976:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393913.810980:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.811023:0:6630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.811037:0:6630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 8 pid: 6630 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.811051:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831368192:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393913.811326:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81eea80 going to sleep for 11 seconds 00000100:00100000:1.0:1785393913.815338:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831368192:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393913.815364:0:6630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.817293:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.818314:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807247872 00000100:00100000:1.0:1785393913.818323:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807247872 00010000:00010000:1.0:1785393913.818362:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 9 pid: 6630 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.818424:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1785393913.818435:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807247872:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393913.818453:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393913.818476:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 9 pid: 6630 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.818490:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 9 pid: 6630 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.818512:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b164a16a/0xcc9b96d8b362a629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ae expref: 9 pid: 6630 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.818526:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393913.818531:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393913.818537:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.818546:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.818592:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393913.818643:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807247872:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 209us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.818649:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00010000:00010000:2.0:1785393913.820041:0:6630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820056:0:6630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820084:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820092:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820100:0:6630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820120:0:6630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbe00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393913.820124:0:6630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820132:0:6630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820158:0:6630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.820167:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362a63e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.820234:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807247744:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 9347us (9564us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393913.820243:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1785393913.826692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.827046:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807248128 00000100:00100000:1.0:1785393913.827055:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807248128 00000100:00100000:1.0:1785393913.831304:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1785393913.831324:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+17:11495:x1872120807248128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785393913.831398:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831414:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831427:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831640:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831652:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831660:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831709:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.831729:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 18 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.831743:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368320:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393913.831835:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81eea80 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.849452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.850838:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807248256 00000100:00100000:1.0:1785393913.850848:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807248256 00010000:00010000:1.0:1785393913.850888:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.850923:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1785393913.850934:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2358:x1872120807248256:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393913.850948:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393913.850954:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.850968:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 19 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.850988:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.850993:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.851003:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.851011:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.851030:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393913.851089:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2358:x1872120807248256:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 156us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393913.851096:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:1.0:1785393913.851141:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a60d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd899 expref: 18 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.851176:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368320:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393913.851197:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.851205:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.851211:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785393913.851744:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1785393913.851889:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1785393913.851942:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1785393913.852013:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1872120831368448:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785393913.852060:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393913.852094:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.856343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831368448 00000100:00100000:3.0:1785393913.856354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831368448 00000100:00100000:3.0:1785393913.856425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785393913.856435:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1872120831368448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1785393913.856547:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1872120831368448:12345-0@lo:1000:mdt00_001.0 Request processed in 114us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393913.856555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785393913.856612:0:5832:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1785393913.856620:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf960d880, transno 4294967315 00000100:00100000:1.0:1785393913.856642:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1872120831368448:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1785393913.857164:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1785393913.857238:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1872120831368576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1785393913.858675:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393913.858700:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57000 going to sleep for 11 seconds 00000100:00100000:2.0:1785393913.859628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831368576 00000100:00100000:2.0:1785393913.859635:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831368576 00000100:00100000:2.0:1785393913.859678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785393913.859687:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1872120831368576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785393913.862885:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1872120831368576:12345-0@lo:1000:mdt00_001.0 Request processed in 3192us (4204us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1785393913.862897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785393913.863734:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1872120831368576:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1785393913.863834:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863864:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863871:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863876:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393913.863880:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863887:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863901:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393913.863904:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393913.863909:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863915:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a64c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863944:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863950:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863957:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863962:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393913.863972:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863979:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.863989:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:1.0:1785393913.863992:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393913.863995:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a588 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864026:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864042:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864050:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864081:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.864095:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 21 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.864108:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff948700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368704:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393913.869138:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57000 going to sleep for 11 seconds 00000100:00100000:3.0:1785393913.874356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393913.875224:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807248384 00000100:00100000:2.0:1785393913.875245:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807248384 00010000:00010000:2.0:1785393913.875292:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 22 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.875338:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1785393913.875348:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2359:x1872120807248384:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393913.875363:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393913.875370:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 22 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.875383:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 22 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.875404:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:2.0:1785393913.875409:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.875419:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.875426:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.875444:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393913.875500:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2359:x1872120807248384:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 153us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393913.875508:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:1.0:1785393913.875705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a5a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd87d expref: 21 pid: 5831 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393913.875730:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff948700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368704:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393913.875751:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875760:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875766:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875779:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875786:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875793:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875799:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bba00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393913.875803:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875809:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:1.0:1785393913.875822:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393913.875832:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875839:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a653 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875850:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875856:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875863:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875868:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82baa00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393913.875880:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875887:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875895:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9f00) 00010000:00010000:1.0:1785393913.875898:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785393913.875901:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393913.875907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393913.878356:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfb8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11495:x1872120807248128:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 47034us (51667us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1785393913.878382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000020:00080000:2.0:1785393913.878387:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1785393913.881477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393913.881657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807248640 00000100:00100000:1.0:1785393913.881665:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807248640 00000100:00100000:1.0:1785393913.881708:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1785393913.881744:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd043850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11495:x1872120807248640:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1785393913.882381:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1785393913.883605:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393913.883611:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393913.884113:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1785393913.884123:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1785393913.894683:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1785393913.894789:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894806:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894818:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894826:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894832:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894838:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393913.894851:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785393913.894970:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd043850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:11495:x1872120807248640:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 13223us (13496us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1785393913.894979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000020:00080000:2.0:1785393913.894985:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785393913.896029:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785393913.896038:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.896045:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785393913.896049:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.896056:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.896069:0:7522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93acc89f9000) 00010000:00010000:0.0:1785393913.896072:0:7522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785393913.896076:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.896082:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a65a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393913.896114:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393913.896116:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393913.896117:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393913.960973:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785393914.267206:0:12301:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393914.267214:0:12301:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393914.267546:0:12301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1785393914.267553:0:12301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1785393914.531496:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1785393914.531514:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1785393914.531614:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1785393914.570818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393914.570977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807248896 00000100:00100000:2.0:1785393914.570987:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807248896 00000100:00100000:2.0:1785393914.571044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:2.0:1785393914.571054:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:11506:x1872120807248896:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393914.571085:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393914.571104:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.571340:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a668 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.571354:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.571366:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393914.571376:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1785393914.571537:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8b5 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.571553:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a668 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8b5 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.571561:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393914.571564:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785393914.571567:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0e00, rc 0) 00000100:00100000:2.0:1785393914.571633:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11506:x1872120807248896:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 580us (825us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1785393914.571640:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:3.0:1785393914.576652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393914.578338:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807249024 00000100:00100000:2.0:1785393914.578349:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807249024 00000100:00100000:2.0:1785393914.578405:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:2.0:1785393914.578423:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11506:x1872120807249024:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1785393914.578494:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578510:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578522:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578536:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578544:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578549:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578822:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578831:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578838:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393914.578872:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578883:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578894:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578901:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578907:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393914.578911:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578918:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578928:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393914.578931:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393914.578934:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578940:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578949:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578954:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578959:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578963:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393914.578969:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578975:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578981:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393914.578983:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393914.578986:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.578991:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a67d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579002:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579007:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579012:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579016:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393914.579018:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579023:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579028:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393914.579030:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393914.579037:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.579043:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393914.579121:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11506:x1872120807249024:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 700us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393914.579128:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:1.0:1785393914.709019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393914.734565:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807249280 00000100:00100000:1.0:1785393914.734602:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807249280 00000100:00100000:1.0:1785393914.734800:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:1.0:1785393914.734813:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+24:11509:x1872120807249280:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393914.734848:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393914.734898:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a68b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8bc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.734998:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.735015:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.735036:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.735068:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.735077:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.735114:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.737830:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.737848:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.737859:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785393914.737872:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1785393914.738001:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738010:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738018:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738032:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393914.738037:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738046:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738067:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393914.738071:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393914.738092:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738099:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba800/0xcc9b96d8b362a692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738113:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738120:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738126:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738132:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bba00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393914.738135:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738141:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738149:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc3c44e00) 00010000:00010000:1.0:1785393914.738151:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393914.738154:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738160:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.738213:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a68b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.739164:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.739331:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393914.739336:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393914.739339:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba400, rc 0) 00000100:00100000:1.0:1785393914.739478:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11509:x1872120807249280:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4666us (30471us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1785393914.739489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:0.0:1785393914.767519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393914.767856:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807249408 00000100:00100000:2.0:1785393914.767869:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807249408 00000100:00100000:2.0:1785393914.767947:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1785393914.767957:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11509:x1872120807249408:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1785393914.768023:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768039:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768050:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768075:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768082:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768089:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768095:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393914.768112:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768119:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768129:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393914.768133:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393914.768136:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393914.768142:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a6ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393914.768215:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11509:x1872120807249408:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 259us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393914.768223:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1785393914.795605:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393914.795803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807249664 00000100:00100000:0.0:1785393914.795818:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807249664 00000100:00100000:0.0:1785393914.795896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1785393914.795909:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11509:x1872120807249664:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1785393914.797924:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:11509:x1872120807249664:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 2013us (2322us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1785393914.797935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00010000:00010000:0.0:1785393914.975807:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393914.985050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393914.985153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807249920 00000100:00100000:1.0:1785393914.985164:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807249920 00000100:00100000:1.0:1785393914.985240:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1785393914.985261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:11042:x1872120807249920:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393914.985294:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393914.985321:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a6b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.985451:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.985468:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.985478:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.985520:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393914.985550:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 28 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393914.985565:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831368832:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393914.985733:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57780 going to sleep for 11 seconds 00000100:00100000:1.0:1785393914.988466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393914.988633:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831368832:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393914.988666:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393915.006757:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250048 00000100:00100000:3.0:1785393915.006775:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250048 00010000:00010000:3.0:1785393915.006870:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 29 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393915.006923:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1785393915.006938:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:2359:x1872120807250048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393915.006956:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393915.006963:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 29 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.006979:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 29 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.007037:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba400/0xcc9b96d8b362a6a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8bc expref: 29 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.007058:0:6645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:3.0:1785393915.007064:0:6645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.007076:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.007083:0:6645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.007116:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393915.007193:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:2359:x1872120807250048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 260us (18739us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393915.007202:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00080000:1.0:1785393915.007422:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785393915.007828:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.007838:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393915.007869:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1785393915.008070:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82baa00/0xcc9b96d8b362a6b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.008088:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.008097:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393915.008107:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785393915.008110:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bba00, rc 0) 00000100:00100000:0.0:1785393915.008155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11042:x1872120807249920:12345-192.168.203.12@tcp:101:bash.0 Request processed in 22897us (23117us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1785393915.008163:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1785393915.029717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393915.029824:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250304 00000100:00100000:2.0:1785393915.029841:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250304 00000100:00100000:2.0:1785393915.029896:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1785393915.029905:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11042:x1872120807250304:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1785393915.030445:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.030477:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.030488:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393915.030537:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1785393915.030561:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002b66ec7 reply state 0000000090aba6e7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393915.030598:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1785393915.030642:0:10972:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1785393915.030730:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11042:x1872120807250304:12345-192.168.203.12@tcp:36:bash.0 Request processed in 825us (1020us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1785393915.030737:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000020:00080000:2.0:1785393915.030742:0:10972:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1785393915.050556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:1.0:1785393915.050762:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050778:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050786:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050792:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393915.050798:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050806:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050827:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393915.050839:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393915.050853:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.050882:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393915.051020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250432 00000100:00100000:3.0:1785393915.051032:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250432 00000100:00100000:3.0:1785393915.051092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:3.0:1785393915.051102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11042:x1872120807250432:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785393915.051132:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393915.051152:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a6d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8ca expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.051236:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ca expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.051273:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ca expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393915.051297:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:3.0:1785393915.051300:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785393915.051302:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785393915.051374:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11042:x1872120807250432:12345-192.168.203.12@tcp:101:bash.0 Request processed in 272us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393915.051382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:2.0:1785393915.056211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393915.056323:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250560 00000100:00100000:1.0:1785393915.056336:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250560 00000100:00100000:1.0:1785393915.056412:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1785393915.056423:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:11042:x1872120807250560:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393915.056440:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393915.056458:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8d1 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785393915.056481:0:6632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a6af2f6, atime: 0x6a6af2f4, ctime: 0x6a6af2f6, blocks: 0xb 00010000:00010000:1.0:1785393915.056499:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:1.0:1785393915.056503:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393915.056511:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.056526:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.056538:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba800, rc 0) 00000100:00100000:1.0:1785393915.056618:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:11042:x1872120807250560:12345-192.168.203.12@tcp:101:bash.0 Request processed in 197us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393915.056625:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00080000:3.0:1785393915.057280:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393915.085401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393915.086945:0:6637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250688 00000100:00100000:3.0:1785393915.086955:0:6637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250688 00002000:00010000:3.0:1785393915.086993:0:6637:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1785393915.086997:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7e7c000 with x1872120807250688 ext(0->18446744073709551615) 00002000:00010000:3.0:1785393915.087009:0:6637:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7e7c000. 00000100:00100000:3.0:1785393915.087041:0:6637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1785393915.087050:0:6637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807250688:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:3.0:1785393915.087431:0:6637:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1785393915.087435:0:6637:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1785393910 -> 1785393914 00002000:00010000:3.0:1785393915.087438:0:6637:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1785393908 -> 1785393908 00002000:00010000:3.0:1785393915.087440:0:6637:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1785393910 -> 1785393914 00002000:00010000:3.0:1785393915.087443:0:6637:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1785393915.087503:0:6637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2358:x1872120807250688:12345-192.168.203.12@tcp:10:bash.0 Request processed in 453us (2110us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1785393915.087511:0:6637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00002000:00010000:3.0:1785393915.087525:0:6637:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1785393915.087529:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf7e7c000 with x1872120807250688 ext(0->18446744073709551615) 00002000:00010000:3.0:1785393915.087533:0:6637:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf7e7c000. 00000100:00100000:2.0:1785393915.327459:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393915.327538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807250816 00000100:00100000:0.0:1785393915.327547:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807250816 00000100:00100000:0.0:1785393915.327621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1785393915.327631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11523:x1872120807250816:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1785393915.327697:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.327712:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.327723:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.327736:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.327744:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.327750:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328126:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328150:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393915.328184:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328195:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328202:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328209:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328215:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393915.328315:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328324:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328336:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393915.328339:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393915.328343:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328350:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a6df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328362:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328373:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328380:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328385:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393915.328388:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328394:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328402:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd96a4d00) 00010000:00010000:0.0:1785393915.328404:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393915.328406:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328412:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328425:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328430:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328436:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328441:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393915.328448:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328454:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328461:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:0.0:1785393915.328463:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393915.328466:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.328472:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a6ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393915.328536:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11523:x1872120807250816:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 906us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393915.328544:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1785393915.492476:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393915.492565:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807251072 00000100:00100000:2.0:1785393915.492595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807251072 00000100:00100000:2.0:1785393915.492650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1785393915.492660:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+32:11526:x1872120807251072:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393915.492679:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393915.492697:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a6f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8d8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492760:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492784:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492795:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492810:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492816:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.492822:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493117:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493127:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493135:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393915.493144:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1785393915.493233:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493249:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493256:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493268:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.493272:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493280:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493292:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393915.493294:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.493299:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493305:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a6fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493317:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493323:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493329:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493334:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.493337:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493343:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493360:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393915.493362:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.493365:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493371:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493406:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a6f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d8 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493419:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d8 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.493426:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393915.493428:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785393915.493431:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393915.493489:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11526:x1872120807251072:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 830us (1020us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1785393915.493496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:1.0:1785393915.511765:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393915.511863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807251200 00000100:00100000:0.0:1785393915.511872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807251200 00000100:00100000:0.0:1785393915.511935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:0.0:1785393915.511944:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11526:x1872120807251200:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1785393915.512002:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.512019:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.512029:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.512068:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.512092:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 34 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393915.512106:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368960:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393915.512197:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e540 going to sleep for 11 seconds 00000100:00100000:0.0:1785393915.514900:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393915.515034:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1872120831368960:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393915.515056:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393915.524297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807251456 00000100:00100000:3.0:1785393915.524312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807251456 00000100:00100000:3.0:1785393915.524380:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1785393915.524389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:5579:x1872120807251456:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1785393915.524692:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:5579:x1872120807251456:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 303us (9796us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1785393915.524700:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1785393915.533929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393915.534026:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807251584 00000100:00100000:2.0:1785393915.534035:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807251584 00010000:00010000:2.0:1785393915.534073:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 36 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393915.534126:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1785393915.534135:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8529850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:2358:x1872120807251584:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393915.534174:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393915.534182:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 36 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534195:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 36 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534230:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bba00/0xcc9b96d8b362a6bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8c3 expref: 36 pid: 5831 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534253:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393915.534258:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534268:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534275:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.534302:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393915.534358:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8529850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:2358:x1872120807251584:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 223us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393915.534366:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:1.0:1785393915.534494:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534503:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534530:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534537:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534543:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534550:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393915.534554:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534561:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534603:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:1.0:1785393915.534606:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785393915.534609:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.534625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393915.534662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11526:x1872120807251200:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 22719us (22905us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393915.534669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1785393915.537186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393915.537379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807251840 00000100:00100000:3.0:1785393915.537386:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807251840 00000100:00100000:3.0:1785393915.537427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1785393915.537434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+34:11526:x1872120807251840:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1785393915.537646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11526:x1872120807251840:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 211us (465us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1785393915.537653:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1785393915.766960:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393915.767813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807252096 00000100:00100000:2.0:1785393915.767822:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807252096 00000100:00100000:2.0:1785393915.767875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:2.0:1785393915.767885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+35:11537:x1872120807252096:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1785393915.767919:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393915.767939:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a71e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768001:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768014:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768025:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768038:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768046:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768053:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768336:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768345:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768352:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393915.768361:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1785393915.768458:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768466:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768471:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768477:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.768482:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768489:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768500:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393915.768503:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.768506:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768511:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768520:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768525:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768530:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768535:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.768544:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768549:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768556:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393915.768558:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.768560:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768566:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a72c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768658:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a71e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8df expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768673:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8df expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.768680:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393915.768683:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393915.768685:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393915.768748:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11537:x1872120807252096:12345-192.168.203.12@tcp:101:cat.0 Request processed in 863us (1796us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1785393915.768755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:1.0:1785393915.797149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393915.797286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807252352 00000100:00100000:3.0:1785393915.797296:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807252352 00000100:00100000:3.0:1785393915.797352:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1785393915.797362:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11537:x1872120807252352:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1785393915.797641:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:11537:x1872120807252352:12345-192.168.203.12@tcp:35:cat.0 Request processed in 279us (499us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1785393915.797648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1785393915.887758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393915.888196:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807252608 00000100:00100000:2.0:1785393915.888207:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807252608 00000100:00100000:2.0:1785393915.888268:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1785393915.888278:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:11538:x1872120807252608:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1785393915.888347:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1785393915.888373:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8df expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888394:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d8 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888407:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1c00/0xcc9b96d8b362a6d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ca expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888418:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc3c44200) 00010000:00010000:2.0:1785393915.888428:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785393915.888446:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888458:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888468:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888481:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888488:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.888495:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.891735:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.896184:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.896207:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785393915.903446:0:10972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1785393915.903462:0:10972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 447934891503ns, next at 448934888016ns, rc = 0 00010000:00010000:2.0:1785393915.903551:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903598:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903611:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903619:0:10972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903625:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903631:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.903655:0:10972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785393915.904842:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785393915.904849:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.904856:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785393915.904860:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.904868:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.904880:0:7522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:0.0:1785393915.904883:0:7522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785393915.904887:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393915.904895:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393915.904897:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785393915.904898:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393915.907220:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907280:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907287:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907293:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907298:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.907302:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907308:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907319:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393915.907322:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785393915.907326:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907332:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a74f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907352:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907358:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907364:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907374:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.907377:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907383:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907391:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393915.907393:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.907396:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.907401:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a741 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393915.907411:0:10972:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dbdbb0b8 reply state 0000000085344e25 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393915.907420:0:10972:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785393915.907509:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+37:11538:x1872120807252608:12345-192.168.203.12@tcp:36:rm.0 Request processed in 19229us (19773us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1785393915.907519:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00010000:00010000:2.0:1785393915.914299:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914316:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914324:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914347:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393915.914352:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914361:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914377:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9d00) 00010000:00010000:2.0:1785393915.914380:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393915.914384:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393915.914391:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a748 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393915.999721:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393916.091868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.092090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807252864 00000100:00100000:2.0:1785393916.092100:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807252864 00000100:00100000:2.0:1785393916.092159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1785393916.092169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+36:11544:x1872120807252864:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785393916.092195:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393916.092216:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a75d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8e6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092347:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092363:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092389:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092404:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092411:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.092417:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785393916.093435:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1785393916.093712:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.093724:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.093732:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095644:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095656:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095663:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095669:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393916.095681:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095689:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095701:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393916.095704:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393916.095708:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.095715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a764 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785393916.095731:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ed14401 reply state 00000000116cff9f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393916.096779:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785393916.096832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a75d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.096847:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.096854:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393916.096856:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393916.096859:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:2.0:1785393916.099317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:11544:x1872120807252864:12345-192.168.203.12@tcp:101:bash.0 Request processed in 7141us (7449us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1785393916.099327:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00010000:00010000:1.0:1785393916.119364:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119381:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119389:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119395:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393916.119401:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119408:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119423:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9d00) 00010000:00010000:1.0:1785393916.119427:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393916.119446:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.119452:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a76b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393916.123564:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393916.130428:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807252992 00000100:00100000:0.0:1785393916.130468:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807252992 00000100:00100000:0.0:1785393916.130547:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1785393916.130557:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807252992:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1785393916.130614:0:8307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393916.130637:0:8307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8ed expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393916.130662:0:8307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785393916.130682:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1785393916.130686:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785393916.130695:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 6 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.130710:0:8307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 6 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.130735:0:8307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044000, rc 0) 00000100:00100000:0.0:1785393916.130803:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807252992:12345-192.168.203.12@tcp:101:bash.0 Request processed in 248us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393916.130810:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00080000:3.0:1785393916.130996:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785393916.138013:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393916.138224:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807253120 00000100:00100000:1.0:1785393916.138242:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807253120 00000100:00100000:1.0:1785393916.138297:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1785393916.138306:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:11544:x1872120807253120:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785393916.138324:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393916.138339:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8f4 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.138369:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.138379:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393916.138383:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393916.138389:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.138865:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.138890:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393916.138923:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831369088:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393916.139011:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57000 going to sleep for 11 seconds 00000100:00100000:2.0:1785393916.146991:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6632:1872120831369088:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393916.147027:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.147060:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb800, rc 0) 00000100:00100000:2.0:1785393916.147121:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:11544:x1872120807253120:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8815us (9116us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.147129:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1785393916.147293:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393916.147422:0:6645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807253248 00000100:00100000:3.0:1785393916.147429:0:6645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807253248 00010000:00010000:3.0:1785393916.147461:0:6645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393916.147497:0:6645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:3.0:1785393916.147506:0:6645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807253248:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393916.147519:0:6645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393916.147540:0:6645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.147553:0:6645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.147604:0:6645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f625c54f/0xcc9b96d8b362a780 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8ed expref: 7 pid: 8307 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.147620:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393916.147623:0:6645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393916.147631:0:6645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.147641:0:6645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.147672:0:6645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393916.147695:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831369216:192.168.203.12@tcp:105: 00000100:00100000:3.0:1785393916.147744:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393916.152522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393916.152648:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad00210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6645:1872120831369216:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785393916.152671:0:6645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393916.152728:0:6645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2359:x1872120807253248:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5223us (5436us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393916.152738:0:6645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1785393916.153006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807253504 00000100:00100000:0.0:1785393916.153013:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807253504 00000100:00100000:0.0:1785393916.153058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1785393916.153066:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+38:11544:x1872120807253504:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1785393916.153390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:11544:x1872120807253504:12345-192.168.203.12@tcp:35:bash.0 Request processed in 324us (875us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1785393916.153409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1785393916.449052:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831369600:0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.449114:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393916.449173:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785393916.449179:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831369728:0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.449201:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393916.449245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369600 00000100:00100000:2.0:1785393916.449251:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369600 00000100:00100000:2.0:1785393916.449297:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1785393916.449305:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831369600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.449352:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831369600:12345-0@lo:400:kworker.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.449359:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1785393916.449393:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831369600:0@lo:400:kworker.0 00000100:00100000:3.0:1785393916.449832:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831369472:0@lo:400:kworker.0 00000100:00100000:3.0:1785393916.449861:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393916.449893:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831369984:0@lo:400:kworker.0 00000100:00100000:3.0:1785393916.449930:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393916.449962:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785393916.449967:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc889ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831369344:0@lo:400:kworker.0 00000100:00100000:3.0:1785393916.449992:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393916.450010:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831369856:0@lo:400:kworker.0 00000100:00100000:3.0:1785393916.450026:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1785393916.450047:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393916.450145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369344 00000100:00100000:2.0:1785393916.450149:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369344 00000100:00100000:2.0:1785393916.450180:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1785393916.450187:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831369344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.450220:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831369344:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.450245:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1785393916.450280:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc889ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831369344:0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.450297:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369472 00000100:00100000:2.0:1785393916.450300:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369472 00000100:00100000:2.0:1785393916.450321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369856 00000100:00100000:2.0:1785393916.450323:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369856 00000100:00100000:2.0:1785393916.450349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1785393916.450355:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831369472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.450386:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad00210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831369472:12345-0@lo:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.450391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1785393916.450403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1785393916.450407:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.450428:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831369856:12345-0@lo:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.450433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:2.0:1785393916.450444:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393916.450458:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831369856:0@lo:400:kworker.0 00000100:00100000:2.0:1785393916.450479:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831369472:0@lo:400:kworker.0 00000100:00100000:1.0:1785393916.450587:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369728 00000100:00100000:1.0:1785393916.450591:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369728 00000100:00100000:1.0:1785393916.450624:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831369984 00000100:00100000:1.0:1785393916.450626:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831369984 00000100:00100000:1.0:1785393916.450645:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1785393916.450651:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831369728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393916.450685:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831369728:12345-0@lo:400:kworker.0 Request processed in 34us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393916.450691:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1785393916.450702:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785393916.450707:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831369984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393916.450732:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831369984:12345-0@lo:400:kworker.0 Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393916.450747:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785393916.450768:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831369728:0@lo:400:kworker.0 00000100:00100000:1.0:1785393916.450787:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1785393916.450791:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1785393916.450805:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf7e40380, transno 4294967307 00000100:00100000:1.0:1785393916.450812:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831369984:0@lo:400:kworker.0 00000100:00080000:2.0:1785393916.450947:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393916.450951:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393916.713683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.713763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807253632 00000100:00100000:2.0:1785393916.713780:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807253632 00000100:00100000:2.0:1785393916.713836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:2.0:1785393916.713844:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+39:11560:x1872120807253632:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393916.713879:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393916.713897:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a78e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd8fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.713961:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.713981:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.713991:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393916.714050:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1785393916.714053:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393916.714082:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.714103:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a78e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8fb expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.714117:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8fb expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.714124:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393916.714126:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785393916.714129:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393916.714181:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11560:x1872120807253632:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 338us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.714194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:2.0:1785393916.737437:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393916.737593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807253888 00000100:00100000:0.0:1785393916.737608:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807253888 00000100:00100000:0.0:1785393916.737679:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:0.0:1785393916.737689:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+40:11560:x1872120807253888:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393916.737710:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393916.737729:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a79c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd902 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.737837:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a7a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.737984:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.737998:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393916.738016:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1785393916.738124:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a79c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd902 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.738140:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a7a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd902 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.738148:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:0.0:1785393916.738150:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393916.738153:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044000, rc 0) 00000100:00100000:0.0:1785393916.739312:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+42:11560:x1872120807253888:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1622us (1887us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1785393916.739321:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1785393916.757325:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.757681:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254016 00000100:00100000:2.0:1785393916.757693:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254016 00000100:00100000:2.0:1785393916.757775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1785393916.757787:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+42:2361:x1872120807254016:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393916.757807:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393916.757850:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a7a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd902 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.757875:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393916.757880:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393916.757950:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:2361:x1872120807254016:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 165us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.757958:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785393916.759556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.762028:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254272 00000100:00100000:2.0:1785393916.762055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254272 00000100:00100000:2.0:1785393916.762140:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1785393916.762151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+41:11560:x1872120807254272:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393916.762184:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393916.762211:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd909 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.762349:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.762366:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.762701:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393916.762719:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1785393916.764014:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd909 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.765485:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd909 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.765501:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393916.765505:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785393916.765509:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393916.766547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:11560:x1872120807254272:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4391us (6991us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1785393916.766559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1785393916.827623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393916.827740:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254400 00000100:00100000:1.0:1785393916.827753:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254400 00000100:00100000:1.0:1785393916.827842:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1785393916.827854:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+6:2358:x1872120807254400:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1785393916.827916:0:6630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.827941:0:6630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.827951:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785393916.827956:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393916.827961:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.828037:0:6630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.828055:0:6630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 6 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393916.828074:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6630:1872120831370112:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393916.828202:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6a57cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393916.851008:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6630:1872120831370112:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393916.851047:0:6630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393916.852146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393916.852244:0:6636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254528 00000100:00100000:0.0:1785393916.852253:0:6636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254528 00002000:00100000:0.0:1785393916.852314:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93acff96f100 x1872120807254528/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:127/0 lens 504/0 e 0 to 0 dl 1785393927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393916.852325:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff96f100 with x1872120807254528 ext(0->8) 00010000:00010000:0.0:1785393916.852335:0:6636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 7 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.852352:0:6636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 7 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393916.852360:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acff96f100 00000100:00100000:0.0:1785393916.852398:0:6636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1785393916.852410:0:6636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807254528:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:0.0:1785393916.853078:0:6636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807254528:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 668us (933us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1785393916.853087:0:6636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:0.0:1785393916.853096:0:6636:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93acff96f100 x1872120807254528/t4294967308(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:127/0 lens 504/448 e 0 to 0 dl 1785393927 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785393916.853105:0:6636:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff96f100 with x1872120807254528 ext(0->8) 00010000:00010000:0.0:1785393916.853112:0:6636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.853138:0:6636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785393916.853146:0:6636:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93acff96f100 00000100:00100000:1.0:1785393916.858545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.862795:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254656 00000100:00100000:2.0:1785393916.862814:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254656 00010000:00010000:2.0:1785393916.862884:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393916.862944:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1785393916.862974:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807254656:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393916.862992:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785393916.863017:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785393916.863020:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785393915 00002000:00010000:2.0:1785393916.863022:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785393915 00002000:00010000:2.0:1785393916.863024:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785393915 00010000:00010000:2.0:1785393916.863030:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.863058:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.863093:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362a787 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8f4 expref: 9 pid: 6632 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.863114:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393916.863119:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785393916.863126:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.863137:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.863176:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393916.863262:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807254656:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 289us (4730us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.863270:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:1.0:1785393916.863933:0:6630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.863959:0:6630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.863990:0:6630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.863999:0:6630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.864008:0:6630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.864016:0:6630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393916.864021:0:6630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.864040:0:6630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.864058:0:6630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393916.864074:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ab098a/0xcc9b96d8b362a7c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393916.864158:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807254400:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 36306us (36596us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393916.864166:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1785393916.874147:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393916.874267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807254912 00000100:00100000:0.0:1785393916.874280:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807254912 00000100:00100000:0.0:1785393916.874353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1785393916.874367:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd041050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+43:11560:x1872120807254912:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:0.0:1785393916.874456:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd909 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393916.874853:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1785393916.874902:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1785393916.875417:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1785393916.875479:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.875496:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.875506:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.875549:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.875566:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 47 pid: 5831 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393916.875615:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1872120831370240:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785393916.875725:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1785393916.885685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.885812:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255040 00000100:00100000:2.0:1785393916.885823:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255040 00010000:00010000:2.0:1785393916.885883:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 48 pid: 5831 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393916.885935:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1785393916.885945:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+48:2359:x1872120807255040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393916.885961:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393916.885969:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 48 pid: 5831 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.885983:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 48 pid: 5831 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.886010:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:2.0:1785393916.886016:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.886027:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.886035:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.886054:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393916.886123:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+48:2359:x1872120807255040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 178us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.886130:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00010000:00010000:0.0:1785393916.888403:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8e6 expref: 47 pid: 5831 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393916.888432:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1872120831370240:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393916.888463:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.888474:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393916.888479:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785393916.889400:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1785393916.892227:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1785393916.892449:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1872120831370368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785393916.892560:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393916.893033:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785393916.907282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831370368 00000100:00100000:1.0:1785393916.907304:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831370368 00000100:00100000:0.0:1785393916.907525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785393916.907537:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1872120831370368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785393916.907714:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1872120831370368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (15154us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393916.907723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785393916.907821:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1872120831370368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1785393916.908526:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1785393916.908665:0:5835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1872120831370496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1785393916.908714:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393916.908753:0:5835:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785393916.908876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831370496 00000100:00100000:2.0:1785393916.908889:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831370496 00000100:00100000:2.0:1785393916.908920:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785393916.908928:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1872120831370496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785393916.909123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1872120831370496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (407us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1785393916.909130:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785393916.909316:0:5835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1872120831370496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1785393916.909372:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1785393916.909414:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909427:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909436:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909443:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393916.909448:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909457:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909474:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:3.0:1785393916.909477:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1785393916.909482:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393916.909489:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a7cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785393916.912238:0:5835:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1785393916.912404:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1785393916.912418:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448943847181ns, next at 449943844082ns, rc = 0 00000001:00080000:3.0:1785393916.912431:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1785393916.912503:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9b00) 00010000:00010000:3.0:1785393916.912508:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785393916.912520:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd909 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393916.918460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd041050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:11560:x1872120807254912:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 44079us (44310us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1785393916.918477:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00080000:3.0:1785393916.918486:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785393916.929859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.929960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255168 00000100:00100000:2.0:1785393916.929974:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255168 00000100:00100000:2.0:1785393916.930043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1785393916.930055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+50:11560:x1872120807255168:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393916.930099:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393916.930137:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd910 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.930214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd910 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.930240:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd910 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393916.930262:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393916.930266:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785393916.930270:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0000, rc 0) 00000100:00100000:2.0:1785393916.930340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:11560:x1872120807255168:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 287us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393916.930348:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1785393916.943923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393916.944536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255424 00000100:00100000:2.0:1785393916.944559:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255424 00000100:00100000:2.0:1785393916.944645:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1785393916.944666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+51:11560:x1872120807255424:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393916.944977:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:11560:x1872120807255424:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 321us (1077us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1785393916.944986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1785393916.960116:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831370624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785393916.960211:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393916.960467:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831370624 00000100:00100000:3.0:1785393916.960478:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831370624 00000100:00100000:3.0:1785393916.960542:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1785393916.960554:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831370624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785393916.960610:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393916.960692:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831370624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393916.960701:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785393916.961966:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831370624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785393917.024628:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393917.143197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.143361:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255552 00000100:00100000:0.0:1785393917.143373:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255552 00000100:00100000:0.0:1785393917.143467:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1785393917.143480:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:11570:x1872120807255552:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1785393917.143616:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143636:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143650:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143667:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143675:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143683:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143800:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143810:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143818:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393917.143886:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143900:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143908:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143916:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143922:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393917.143927:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143935:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143947:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393917.143950:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393917.143955:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143962:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a7db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143976:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143982:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143994:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.143999:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393917.144002:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144008:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144015:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd96a4700) 00010000:00010000:0.0:1785393917.144017:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393917.144020:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144025:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a7e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144040:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144046:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144053:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144058:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393917.144061:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144076:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144084:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393917.144086:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393917.144089:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.144095:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a7e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393917.144196:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:11570:x1872120807255552:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 719us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393917.144204:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00080000:2.0:1785393917.144644:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393917.265728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393917.265839:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255808 00000100:00100000:2.0:1785393917.265850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255808 00000100:00100000:2.0:1785393917.265928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:2.0:1785393917.265939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+52:11573:x1872120807255808:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393917.265967:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393917.265994:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd917 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266112:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266130:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266144:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266162:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266170:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.266200:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.275664:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.275689:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.275704:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393917.275739:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1785393917.276382:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276391:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276399:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276405:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393917.276409:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276417:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276433:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:3.0:1785393917.276436:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393917.276441:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276448:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a7f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276466:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276473:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276491:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276497:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393917.276501:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276507:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276516:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc89f9100) 00010000:00010000:3.0:1785393917.276518:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393917.276521:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276527:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1a00/0xcc9b96d8b362a7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276697:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a7f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd917 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276715:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd917 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.276723:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393917.276725:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785393917.276727:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785393917.276819:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:11573:x1872120807255808:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 10881us (11103us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1785393917.276839:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:0.0:1785393917.290733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393917.290978:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807255936 00000100:00100000:2.0:1785393917.290989:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807255936 00000100:00100000:2.0:1785393917.291239:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:2.0:1785393917.291252:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:11573:x1872120807255936:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1785393917.291352:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291375:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291388:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291423:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291431:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291438:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291445:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393917.291451:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291459:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291491:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393917.291494:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393917.291500:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.291507:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393917.291622:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:11573:x1872120807255936:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 372us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393917.291630:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:0.0:1785393917.330673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393917.330760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807256192 00000100:00100000:2.0:1785393917.330772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807256192 00000100:00100000:2.0:1785393917.330829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1785393917.330839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+54:11573:x1872120807256192:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785393917.331151:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:11573:x1872120807256192:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 312us (489us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1785393917.331159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000004:00080000:3.0:1785393917.471857:0:6674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449503283372ns, next at 450503280369ns, rc = 0 00000100:00100000:0.0:1785393917.472004:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785393917.472033:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831370752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393917.472140:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393917.472566:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831370752 00000100:00100000:3.0:1785393917.472603:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831370752 00000100:00100000:3.0:1785393917.472658:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785393917.472667:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831370752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393917.472710:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393917.472783:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831370752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393917.472791:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1785393917.472887:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831370752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393917.482778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.484208:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807256448 00000100:00100000:0.0:1785393917.484223:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807256448 00000100:00100000:0.0:1785393917.484311:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1785393917.484324:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+55:11583:x1872120807256448:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1785393917.484356:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393917.484360:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785393917.484400:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8fb expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484446:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393917.484452:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393917.484468:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a81a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd91e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484630:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484647:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484659:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393917.484670:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1785393917.484815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a81a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd91e expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484831:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd91e expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.484839:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393917.484842:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393917.484844:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393917.484932:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:11583:x1872120807256448:12345-192.168.203.12@tcp:101:bash.0 Request processed in 611us (2167us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1785393917.484940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1785393917.501526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393917.501680:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807256704 00000100:00100000:3.0:1785393917.501692:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807256704 00000100:00100000:3.0:1785393917.501764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:3.0:1785393917.501776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:11583:x1872120807256704:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:3.0:1785393917.501852:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1785393917.501885:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd91e expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.501911:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1800/0xcc9b96d8b362a805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd917 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.501923:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393917.501929:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785393917.502213:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.502238:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.502264:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785393917.503259:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1785393917.503630:0:5833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c053fd7d reply state 00000000e39693a2 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393917.503644:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785393917.503831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:11583:x1872120807256704:12345-192.168.203.12@tcp:36:bash.0 Request processed in 2054us (2317us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1785393917.503840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000020:00080000:3.0:1785393917.503846:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785393917.511192:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511216:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511233:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511241:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393917.511247:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511257:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511277:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393917.511292:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393917.511320:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393917.511327:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0600/0xcc9b96d8b362a82f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393917.512216:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.513242:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807256832 00000100:00100000:0.0:1785393917.513256:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807256832 00000100:00100000:0.0:1785393917.513506:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:0.0:1785393917.513518:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+56:11583:x1872120807256832:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1785393917.513550:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393917.513607:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd925 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513716:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513731:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513742:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393917.513775:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785393917.513779:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393917.513801:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513833:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513850:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.513858:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393917.513861:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393917.513877:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0045800, rc 0) 00000100:00100000:0.0:1785393917.513961:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:11583:x1872120807256832:12345-192.168.203.12@tcp:101:bash.0 Request processed in 446us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393917.513970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:2.0:1785393917.520648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393917.520735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257088 00000100:00100000:1.0:1785393917.520748:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257088 00000100:00100000:1.0:1785393917.520816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1785393917.520827:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+57:11583:x1872120807257088:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1785393917.521211:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:11583:x1872120807257088:12345-192.168.203.12@tcp:35:bash.0 Request processed in 384us (575us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1785393917.521220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1785393917.686768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393917.686885:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257216 00000100:00100000:3.0:1785393917.686898:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257216 00000100:00100000:2.0:1785393917.687423:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1785393917.687440:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+58:11589:x1872120807257216:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393917.687472:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393917.687498:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd92c expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687618:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687651:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687666:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393917.687743:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1785393917.687746:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393917.687770:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687797:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd92c expref: 60 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687816:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd92c expref: 59 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.687826:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393917.687830:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785393917.687834:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785393917.687909:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807257216:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 475us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393917.687927:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1785393917.704712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.704839:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257344 00000100:00100000:0.0:1785393917.704851:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257344 00000100:00100000:0.0:1785393917.704928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1785393917.704939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807257344:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393917.704965:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393917.704992:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd933 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705073:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705090:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705115:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705134:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705141:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705148:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705269:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705647:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705655:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393917.705696:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785393917.705702:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393917.705721:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705734:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705743:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705749:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705756:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705761:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393917.705766:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705774:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705786:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393917.705789:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393917.705801:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705807:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705822:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705828:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705833:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705838:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393917.705840:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705846:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705853:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acd96a4700) 00010000:00010000:0.0:1785393917.705855:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785393917.705857:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705863:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705894:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd933 expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705918:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd933 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.705926:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393917.705928:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393917.705931:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393917.705992:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11589:x1872120807257344:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1055us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393917.706000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1785393917.712319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393917.712505:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257472 00000100:00100000:2.0:1785393917.712518:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257472 00000100:00100000:2.0:1785393917.712631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1785393917.712643:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:2358:x1872120807257472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393917.712682:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393917.712714:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd933 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.712734:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393917.712739:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393917.712807:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:2358:x1872120807257472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 166us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393917.712815:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1785393917.726849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393917.726956:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257728 00000100:00100000:2.0:1785393917.726968:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257728 00000100:00100000:2.0:1785393917.727040:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:2.0:1785393917.727053:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807257728:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393917.727088:0:10972:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393917.727122:0:10972:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a86e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd93a expref: -99 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.727258:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.727278:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.727301:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.727352:0:10972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.727829:0:10972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 60 pid: 5832 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393917.727847:0:10972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831370880:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393917.727984:0:10972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace0186900 going to sleep for 11 seconds 00000100:00100000:2.0:1785393917.743065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.743565:0:10972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831370880:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785393917.743668:0:10972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393917.745997:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807257856 00000100:00100000:1.0:1785393917.746028:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807257856 00010000:00010000:1.0:1785393917.746095:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 61 pid: 5832 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393917.746185:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1785393917.746196:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:2359:x1872120807257856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393917.746217:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393917.746233:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 61 pid: 5832 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746248:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 61 pid: 5832 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746275:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a83d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd925 expref: 61 pid: 5832 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746310:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393917.746317:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746330:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746339:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.746376:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393917.746596:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:2359:x1872120807257856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 399us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393917.746614:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00010000:00010000:2.0:1785393917.746689:0:10972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.746701:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393917.746728:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1785393917.746940:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a86e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 61 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.748175:0:10972:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 60 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393917.748185:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393917.748188:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785393917.748192:0:10972:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785393917.748261:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11589:x1872120807257728:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 21210us (21424us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1785393917.748271:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:2.0:1785393917.759353:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393917.759703:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258112 00000100:00100000:1.0:1785393917.759716:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258112 00000100:00100000:1.0:1785393917.759788:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1785393917.759799:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11589:x1872120807258112:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1785393917.759819:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393917.759849:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0000/0xcc9b96d8b362a7d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd910 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393917.759871:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393917.759877:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393917.759945:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807258112:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 148us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393917.759952:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1785393917.770626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.770879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258240 00000100:00100000:0.0:1785393917.770891:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258240 00000100:00100000:0.0:1785393917.770961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1785393917.770972:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807258240:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:0.0:1785393917.771127:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.771148:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.771164:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785393917.771721:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1785393917.771812:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807258240:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 841us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393917.771821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1785393917.776959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393917.777335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258368 00000100:00100000:0.0:1785393917.777348:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258368 00000100:00100000:0.0:1785393917.777798:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1785393917.777814:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+59:11589:x1872120807258368:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785393917.777841:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393917.777867:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd941 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.777936:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.777947:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.777968:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.777983:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.777996:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393917.778000:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393917.778004:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393917.778028:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044600, rc 0) 00000100:00100000:0.0:1785393917.778113:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11589:x1872120807258368:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 303us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393917.793724:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000040:00080000:2.0:1785393917.984467:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785393917.984478:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393917.984560:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1785393917.984596:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785393917.984789:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831371008:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785393917.984911:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acec1ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1785393918.004075:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.004200:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831371008:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785393918.009210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258496 00000100:00100000:1.0:1785393918.009236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258496 00000100:00100000:1.0:1785393918.009334:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1785393918.009346:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11590:x1872120807258496:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785393918.009392:0:5831:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785393918.009532:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11590:x1872120807258496:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 188us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.009541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1785393918.019930:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.020117:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258624 00000100:00100000:3.0:1785393918.020131:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258624 00000100:00100000:3.0:1785393918.020215:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:3.0:1785393918.020235:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11590:x1872120807258624:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1785393918.020339:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020359:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020375:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020394:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020403:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020428:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020458:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020468:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020476:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393918.020525:0:10972:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1785393918.020530:0:10972:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393918.020545:0:10972:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020558:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020565:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020608:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020614:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.020619:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020627:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020648:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:3.0:1785393918.020651:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393918.020657:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020663:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1a00/0xcc9b96d8b362a891 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020677:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020683:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020688:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020693:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.020696:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020701:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020707:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93acd8302200) 00010000:00010000:3.0:1785393918.020709:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393918.020711:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020716:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362a898 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020751:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020757:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020763:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020768:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.020771:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020777:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020784:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393918.020786:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393918.020789:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.020795:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1400/0xcc9b96d8b362a89f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.020885:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11590:x1872120807258624:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 660us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393918.020893:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:1.0:1785393918.029024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.029142:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807258880 00000100:00100000:0.0:1785393918.029164:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807258880 00000100:00100000:0.0:1785393918.029245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1785393918.029257:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+60:11590:x1872120807258880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.029283:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393918.029311:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a8a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd948 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029447:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029460:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393918.029472:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1785393918.029628:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029636:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029659:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029668:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393918.029673:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029681:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029694:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393918.029697:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785393918.029702:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029709:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045e00/0xcc9b96d8b362a8ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029758:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a8a6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd948 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029769:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:0.0:1785393918.029772:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785393918.029776:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044000/0xcc9b96d8b362a8a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd948 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.029787:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044000, rc 0) 00000100:00100000:0.0:1785393918.029850:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807258880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 595us (847us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1785393918.029868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1785393918.042696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.042820:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807259008 00000100:00100000:3.0:1785393918.042833:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807259008 00000100:00100000:3.0:1785393918.042901:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1785393918.042926:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807259008:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785393918.042973:0:10972:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785393918.043137:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807259008:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 214us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393918.043144:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:1.0:1785393918.048863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.049194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807259264 00000100:00100000:0.0:1785393918.049215:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807259264 00000100:00100000:0.0:1785393918.049304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:0.0:1785393918.049315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807259264:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.049343:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393918.049347:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785393918.049379:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a84b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd92c expref: 61 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.049403:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:0.0:1785393918.049409:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393918.049427:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a8bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd94f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785393918.050036:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1785393918.050295:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a8c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.050312:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.050325:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.050388:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045800/0xcc9b96d8b362a8bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd94f expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.050421:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd94f expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.050430:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4700) 00010000:00010000:0.0:1785393918.050434:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393918.050437:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace0044400, rc 0) 00000100:00100000:0.0:1785393918.050512:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+62:11590:x1872120807259264:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1199us (1663us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1785393918.050520:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00010000:00010000:3.0:1785393918.056344:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393918.057602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.058319:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807259520 00000100:00100000:1.0:1785393918.058333:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807259520 00000100:00100000:1.0:1785393918.058407:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1785393918.058419:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+62:11590:x1872120807259520:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785393918.058504:0:10972:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.058537:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044400/0xcc9b96d8b362a8c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd94f expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058561:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4700) 00010000:00010000:1.0:1785393918.058603:0:10972:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785393918.058629:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058646:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058657:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058671:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058679:0:10972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058685:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058776:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058800:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058807:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058813:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393918.058818:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058827:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058836:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393918.058839:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393918.058843:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058850:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a8d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058861:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058867:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058874:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058879:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785393918.058891:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058898:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058905:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x31bf0cf (ffff93acc3c44500) 00010000:00010000:1.0:1785393918.058908:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393918.058923:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.058931:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a8d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x31bf0cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.059038:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807259520:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 621us (1469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785393918.059047:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1785393918.066297:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.066373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807259648 00000100:00100000:0.0:1785393918.066385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807259648 00000100:00100000:0.0:1785393918.066459:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:0.0:1785393918.066472:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+61:11590:x1872120807259648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.066501:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393918.066560:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd956 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066652:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066668:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066682:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066797:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066822:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.066832:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785393918.066835:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785393918.066839:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58400, rc 0) 00000100:00100000:0.0:1785393918.066905:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+62:11590:x1872120807259648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 437us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393918.066912:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1785393918.078715:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.078899:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807259904 00000100:00100000:0.0:1785393918.078912:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807259904 00000100:00100000:0.0:1785393918.078982:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:0.0:1785393918.078995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+62:11590:x1872120807259904:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.079121:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.079153:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.079170:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785393918.080399:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1785393918.080522:0:5832:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000085d4667 reply state 00000000b8041e5e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393918.080535:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393918.080696:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+64:11590:x1872120807259904:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1702us (1992us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1785393918.080705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:1.0:1785393918.084888:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1785393918.085037:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085051:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085059:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085066:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393918.085071:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085079:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085108:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:2.0:1785393918.085111:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785393918.085117:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.085124:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362a8ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393918.085826:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260032 00000100:00100000:0.0:1785393918.085838:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260032 00000100:00100000:0.0:1785393918.085905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:0.0:1785393918.085916:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+63:11590:x1872120807260032:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.085946:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393918.085967:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd95d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.086049:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 64 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.086064:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 64 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.086087:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785393918.086090:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785393918.086093:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59e00, rc 0) 00000100:00100000:0.0:1785393918.086182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+64:11590:x1872120807260032:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 267us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393918.086190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1785393918.101164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.101383:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260160 00000100:00100000:0.0:1785393918.101395:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260160 00000100:00100000:0.0:1785393918.101492:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:0.0:1785393918.101504:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2358:x1872120807260160:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1785393918.101847:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393918.101979:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2358:x1872120807260160:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 476us (828us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1785393918.101989:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1785393918.113171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.113245:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260416 00000100:00100000:1.0:1785393918.113258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260416 00000100:00100000:1.0:1785393918.113539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:1.0:1785393918.113552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+64:11590:x1872120807260416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785393918.113880:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+65:11590:x1872120807260416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 330us (732us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1785393918.113907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1785393918.118689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.118790:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260672 00000100:00100000:1.0:1785393918.118802:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260672 00000100:00100000:1.0:1785393918.118860:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:1.0:1785393918.118871:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+65:11590:x1872120807260672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785393918.119954:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+65:11590:x1872120807260672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 1080us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.119966:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:3.0:1785393918.129157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.129311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260800 00000100:00100000:0.0:1785393918.129330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260800 00000100:00100000:0.0:1785393918.129408:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:0.0:1785393918.129420:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+65:11590:x1872120807260800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.129465:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393918.129492:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362a8fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd964 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129627:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129645:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129658:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393918.129703:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785393918.129723:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129751:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362a8fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd964 expref: 67 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129770:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd964 expref: 66 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.129779:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785393918.129783:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785393918.129802:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58a00, rc 0) 00000100:00100000:0.0:1785393918.129864:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+66:11590:x1872120807260800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 446us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393918.129873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:3.0:1785393918.135089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393918.136427:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807260928 00000100:00100000:2.0:1785393918.136440:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807260928 00000100:00100000:2.0:1785393918.136527:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1785393918.136539:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+10:2359:x1872120807260928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785393918.136564:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393918.136607:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd96b expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785393918.136640:0:6632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6af2fd, blocks: 0x1 00010000:00010000:2.0:1785393918.136665:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1785393918.136670:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393918.136681:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 11 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.136700:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 11 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.136716:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1e00, rc 0) 00000100:00100000:2.0:1785393918.136787:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:2359:x1872120807260928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 250us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393918.136794:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1785393918.149839:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.149882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.149986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261056 00000100:00100000:0.0:1785393918.149998:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261056 00000100:00100000:0.0:1785393918.150073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 321 00000100:00100000:0.0:1785393918.150085:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807261056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393918.150184:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807261056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393918.150192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 321 00000100:00100000:1.0:1785393918.151507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.151740:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261184 00000100:00100000:0.0:1785393918.151747:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261184 00000100:00100000:0.0:1785393918.151797:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1785393918.151806:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807261184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393918.151862:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807261184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393918.151869:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00080000:1.0:1785393918.152325:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393918.154077:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261312 00000100:00100000:2.0:1785393918.154090:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261312 00000100:00100000:3.0:1785393918.157482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:3.0:1785393918.157499:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807261312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393918.157619:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807261312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 124us (7735us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393918.157628:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00080000:1.0:1785393918.161381:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393918.173828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.175151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261568 00000100:00100000:1.0:1785393918.175165:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261568 00000100:00100000:1.0:1785393918.175245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1785393918.175258:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+66:11590:x1872120807261568:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785393918.175430:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+66:11590:x1872120807261568:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 174us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.175438:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:2.0:1785393918.191822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.191978:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261696 00000100:00100000:1.0:1785393918.192000:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261696 00000100:00100000:2.0:1785393918.192175:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1785393918.192191:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:11590:x1872120807261696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785393918.192216:0:6630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393918.192249:0:6630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd972 expref: -99 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.192323:0:6630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 12 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.192334:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393918.192339:0:6630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785393918.192345:0:6630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 12 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.192387:0:6630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 12 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.192404:0:6630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 12 pid: 6632 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.192420:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831371136:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393918.192549:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace0186900 going to sleep for 11 seconds 00000100:00100000:0.0:1785393918.224809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.225021:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261824 00000100:00100000:3.0:1785393918.225041:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261824 00010000:00010000:3.0:1785393918.225125:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 13 pid: 6632 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.225166:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1785393918.225178:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2359:x1872120807261824:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393918.225196:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393918.225234:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 13 pid: 6632 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.225275:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 13 pid: 6632 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.225307:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393918.225312:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393918.225322:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 13 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.225346:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 13 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.225393:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 13 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.225410:0:5816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1872120831371264:192.168.203.12@tcp:105: 00000100:00100000:3.0:1785393918.225511:0:5816:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acec1ba0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1785393918.226229:0:6630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362a908 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd96b expref: 13 pid: 6632 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.226249:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6630:1872120831371136:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785393918.226279:0:6630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 12 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.226292:0:6630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1a00, rc 0) 00000100:00100000:2.0:1785393918.226359:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+12:11590:x1872120807261696:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 34172us (34550us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393918.226370:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1785393918.238048:0:5816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1872120831371264:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785393918.238094:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393918.238305:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:2359:x1872120807261824:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 13126us (13508us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393918.238326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1785393918.257421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393918.259254:0:6635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807261952 00000100:00100000:2.0:1785393918.259268:0:6635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807261952 00002000:00100000:2.0:1785393918.259351:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93acf9600a80 x1872120807261952/t0(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:129/0 lens 504/0 e 0 to 0 dl 1785393929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785393918.259363:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf9600a80 with x1872120807261952 ext(0->12) 00002000:00010000:2.0:1785393918.259371:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf9600a80 00000100:00100000:2.0:1785393918.259405:0:6635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785393918.259417:0:6635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+11:2358:x1872120807261952:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785393918.271669:0:6635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2358:x1872120807261952:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 12239us (14247us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1785393918.271687:0:6635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:3.0:1785393918.271754:0:6635:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93acf9600a80 x1872120807261952/t4294967320(0) o4->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:129/0 lens 504/448 e 0 to 0 dl 1785393929 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393918.271766:0:6635:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acf9600a80 with x1872120807261952 ext(0->12) 00002000:00010000:3.0:1785393918.271773:0:6635:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acf9600a80 00000100:00100000:0.0:1785393918.276770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.277082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262080 00000100:00100000:3.0:1785393918.277094:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262080 00000100:00100000:3.0:1785393918.277162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1785393918.277173:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+66:11590:x1872120807262080:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1785393918.388620:0:12261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000001:00080000:3.0:1785393918.388664:0:12261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1785393918.388681:0:12261:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acc6a570c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1785393918.388687:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081c400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acc6a57b40 00000020:00080000:3.0:1785393918.388691:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93ad0081c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acf7ec8800 00000004:00080000:3.0:1785393918.388723:0:12261:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1785393918.388748:0:12261:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1785393918.388753:0:12261:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1785393918.388765:0:12261:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acc6af83c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1785393918.388768:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf75bd800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acc6af86c0 00000020:00080000:3.0:1785393918.388771:0:12261:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf75bd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acf7e95400 00000100:00100000:1.0:1785393918.389015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11590:x1872120807262080:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 111840us (112252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.389026:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000020:00080000:3.0:1785393918.391300:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1785393918.391477:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1785393918.391650:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831371520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785393918.391703:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393918.391766:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785393918.391772:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff96ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831371392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785393918.391805:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393918.391951:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831371520 00000100:00100000:3.0:1785393918.391957:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831371520 00000100:00100000:3.0:1785393918.392011:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831371392 00000100:00100000:3.0:1785393918.392015:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831371392 00000100:00100000:3.0:1785393918.392038:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1785393918.392045:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831371520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785393918.392318:0:8307:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1785393918.392351:0:8307:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a6af2fb, atime: 0x6a6af2fb, ctime: 0x6a6af2fb, blocks: 0x1 00010000:00010000:3.0:1785393918.392359:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.392374:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=450s v=(0 0) 00010000:00010000:3.0:1785393918.392378:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393918.392383:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.392398:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.392408:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.392417:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.392441:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785393918.393965:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393918.393974:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.393996:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785393918.394000:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.394012:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.394031:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.394040:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362a916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.394064:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393918.394066:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393918.394068:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393918.394155:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.395359:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831371520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3310us (3652us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1785393918.395369:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1785393918.395393:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262208 00000100:00100000:3.0:1785393918.395399:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262208 00000100:00100000:3.0:1785393918.395422:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785393918.395429:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831371392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785393918.395449:0:8307:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1785393918.395467:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.395483:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.395492:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1785393918.395496:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393918.395501:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.395529:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.395543:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 13 pid: 6632 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.395557:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831371648:192.168.203.12@tcp:104: 00000004:00080000:1.0:1785393918.396468:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acff96ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1785393918.396476:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831371520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785393918.396602:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acec1ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785393918.396632:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1785393918.396641:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+13:2359:x1872120807262208:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00080000:3.0:1785393918.396682:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393918.396687:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785393918.399450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.399475:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262336 00000100:00100000:1.0:1785393918.399480:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262336 00010000:00010000:1.0:1785393918.399509:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 14 pid: 6632 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.399551:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1785393918.399559:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807262336:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393918.399584:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.399590:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 14 pid: 6632 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.399601:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 14 pid: 6632 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.399623:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393918.399626:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393918.399631:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.399640:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.399657:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393918.399694:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+14:2358:x1872120807262336:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.399701:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00010000:00010000:3.0:1785393918.401164:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362a6d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8d1 expref: 13 pid: 6632 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.401184:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831371648:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393918.401323:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.401335:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.401343:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.401353:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.401361:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.401423:0:8307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785393918.402433:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831371392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7001us (10624us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1785393918.402452:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1785393918.404839:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acff96ed80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1785393918.404853:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff96ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831371392:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1785393918.407406:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393918.407417:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.407431:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785393918.407436:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.407446:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.407465:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.407473:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006607220d/0xcc9b96d8b362a91d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.407502:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393918.407504:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393918.407506:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785393918.437725:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1785393918.437747:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1785393918.437755:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:1.0:1785393918.437941:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807262208:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 41296us (43783us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.437963:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1785393918.440965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393918.441450:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262592 00000100:00100000:0.0:1785393918.441459:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262592 00000100:00100000:0.0:1785393918.441522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:0.0:1785393918.441530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11590:x1872120807262592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785393918.441609:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393918.441633:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58a00/0xcc9b96d8b362a901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd964 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.441651:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785393918.441655:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785393918.441682:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.441695:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.441704:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785393918.442327:0:5831:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006224c5e8 reply state 000000009d09f455 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393918.442338:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785393918.442467:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:11590:x1872120807262592:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 935us (1508us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1785393918.442474:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00010000:00010000:3.0:1785393918.445856:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445871:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445879:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445886:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.445890:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445898:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445921:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785393918.445924:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393918.445928:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.445934:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58200/0xcc9b96d8b362a924 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.447542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.447724:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262720 00000100:00100000:3.0:1785393918.447734:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262720 00000100:00100000:3.0:1785393918.447786:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1785393918.447797:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2359:x1872120807262720:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1785393918.448164:0:6630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1785393918.448173:0:6630:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785393916 00002000:00010000:3.0:1785393918.448176:0:6630:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1785393915 00002000:00010000:3.0:1785393918.448178:0:6630:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1785393917 -> 1785393916 00002000:00010000:3.0:1785393918.448181:0:6630:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1785393918.448298:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2359:x1872120807262720:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 502us (760us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1785393918.448306:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:0.0:1785393918.450477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.450610:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807262976 00000100:00100000:3.0:1785393918.450617:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807262976 00000100:00100000:3.0:1785393918.450658:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:3.0:1785393918.450666:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:11590:x1872120807262976:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1785393918.450717:0:10972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.450732:0:10972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.450742:0:10972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.450774:0:10972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.450788:0:10972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 20 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.450803:0:10972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831371776:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393918.451157:0:10972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:3.0:1785393918.453400:0:10972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10972:1872120831371776:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393918.453423:0:10972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393918.454871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.455127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263104 00000100:00100000:1.0:1785393918.455135:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263104 00010000:00010000:1.0:1785393918.455167:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.455214:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1785393918.455231:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:2358:x1872120807263104:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393918.455243:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.455250:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455262:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455282:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362a8e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd956 expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455297:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785393918.455302:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455311:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455334:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.455364:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393918.455419:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:2358:x1872120807263104:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 196us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.455426:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00010000:00010000:0.0:1785393918.455937:0:10972:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.455947:0:10972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.455995:0:10972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456004:0:10972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456010:0:10972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456017:0:10972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785393918.456021:0:10972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456029:0:10972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456040:0:10972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785393918.456042:0:10972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1785393918.456046:0:10972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393918.456063:0:10972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a92b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785393918.456117:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11590:x1872120807262976:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 5451us (5643us total) trans 0 rc -22/-22 00000100:00100000:0.0:1785393918.456125:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:0.0:1785393918.459216:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.459344:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263232 00000100:00100000:3.0:1785393918.459353:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263232 00000100:00100000:3.0:1785393918.459401:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1785393918.459410:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2360:x1872120807263232:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785393918.459446:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.459464:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.459472:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393918.459477:0:8307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785393918.459481:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.459510:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 8 pid: 6630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.459523:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 8 pid: 6630 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.459537:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831371904:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785393918.459634:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc8931900 going to sleep for 11 seconds 00000100:00100000:2.0:1785393918.463478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.463703:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263360 00000100:00100000:1.0:1785393918.463712:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263360 00010000:00010000:1.0:1785393918.463745:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 9 pid: 6630 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.463789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1785393918.463799:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807263360:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393918.463811:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.463840:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 9 pid: 6630 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.463854:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 9 pid: 6630 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.463876:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393918.463880:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785393918.463885:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.463923:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.463946:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393918.463999:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+9:2359:x1872120807263360:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 201us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.464006:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:3.0:1785393918.464715:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362a90f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd972 expref: 8 pid: 6630 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.464731:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7e7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8307:1872120831371904:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393918.464750:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464761:0:8307:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464768:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464792:0:8307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464802:0:8307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464822:0:8307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464830:0:8307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393918.464834:0:8307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464856:0:8307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464869:0:8307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.464876:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a4a400f/0xcc9b96d8b362a932 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.464941:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807263232:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 5531us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393918.464949:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1785393918.468966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.473422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263616 00000100:00100000:3.0:1785393918.473435:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263616 00000100:00100000:2.0:1785393918.473633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1785393918.473645:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11590:x1872120807263616:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785393918.473720:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.473735:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.473746:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.473953:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.473964:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.473972:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.474016:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.474046:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 20 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.474072:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831372032:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785393918.474167:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef180 going to sleep for 11 seconds 00000100:00100000:3.0:1785393918.480640:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831372032:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785393918.480671:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.494463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.495118:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263744 00000100:00100000:1.0:1785393918.495128:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263744 00010000:00010000:1.0:1785393918.495176:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.495233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1785393918.495243:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:2358:x1872120807263744:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393918.495257:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.495264:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495278:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495296:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a8f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd95d expref: 21 pid: 5831 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495312:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785393918.495332:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495341:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495348:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.495382:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393918.495686:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:2358:x1872120807263744:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 443us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.495695:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00010000:00010000:2.0:1785393918.495789:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.495798:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785393918.495961:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1785393918.496101:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1785393918.496146:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1785393918.496258:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831372160:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785393918.496304:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393918.496338:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef900 going to sleep for 11 seconds 00000100:00100000:1.0:1785393918.499729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831372160 00000100:00100000:1.0:1785393918.499741:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831372160 00000100:00100000:1.0:1785393918.499795:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785393918.499804:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1872120831372160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785393918.499925:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1872120831372160:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.499932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785393918.500117:0:5833:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1785393918.500123:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1785393918.500144:0:5833:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93acff96ed80 x1872120831371392/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785393934 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393918.500168:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831372160:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1785393918.500686:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1785393918.500759:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831372288:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785393918.500793:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393918.500824:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef000 going to sleep for 11 seconds 00000100:00100000:1.0:1785393918.500984:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831372288 00000100:00100000:1.0:1785393918.500989:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831372288 00000100:00100000:1.0:1785393918.501008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785393918.501015:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1872120831372288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785393918.501181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1872120831372288:12345-0@lo:1000:mdt00_002.0 Request processed in 165us (386us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1785393918.501196:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785393918.501456:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1872120831372288:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1785393918.501486:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501496:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501504:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501511:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393918.501515:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501523:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501537:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:2.0:1785393918.501540:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785393918.501544:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501551:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362a940 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501606:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501613:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501618:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501630:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0045c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393918.501634:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501640:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501648:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393918.501651:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785393918.501657:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501668:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501677:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.501702:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.501712:0:5833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831372416:192.168.203.12@tcp:105: 00000100:00100000:2.0:1785393918.501758:0:5833:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef000 going to sleep for 11 seconds 00000100:00100000:2.0:1785393918.513757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393918.513903:0:5833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1872120831372416:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785393918.513931:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.513942:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045c00/0xcc9b96d8b362a883 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.513974:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514001:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514014:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514025:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514031:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514038:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514044:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.514059:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514068:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514080:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393918.514083:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785393918.514086:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514093:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362a947 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514112:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514124:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514131:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514136:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785393918.514140:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514146:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514166:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:3.0:1785393918.514169:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785393918.514172:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.514178:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a939 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785393918.514401:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc889ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11590:x1872120807263616:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 40758us (45441us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1785393918.514411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000020:00080000:3.0:1785393918.514416:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1785393918.514898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807263872 00000100:00100000:1.0:1785393918.514905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807263872 00000100:00100000:1.0:1785393918.514958:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1785393918.514967:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11589:x1872120807263872:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:1.0:1785393918.515062:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11589:x1872120807263872:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 95us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.515069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000040:00080000:0.0:1785393918.516241:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393918.516246:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393918.516297:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1785393918.516303:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785393918.522011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.522516:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807264128 00000100:00100000:1.0:1785393918.522524:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807264128 00000100:00100000:1.0:1785393918.522587:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1785393918.522595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93accd043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+23:11590:x1872120807264128:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1785393918.523082:0:5834:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1785393918.523165:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1785393918.524493:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524512:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524524:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524533:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524540:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524546:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.524594:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785393918.524761:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393918.524768:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.524776:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785393918.524787:0:7522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.524794:0:7522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.524806:0:7522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93acc3c44f00) 00010000:00010000:3.0:1785393918.524809:0:7522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785393918.524813:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.524820:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb600/0xcc9b96d8b362a94e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393918.524836:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393918.524838:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393918.524840:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393918.525008:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93accd043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11590:x1872120807264128:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 2410us (3000us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1785393918.525018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:1.0:1785393918.525022:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785393918.525211:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.525560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807264384 00000100:00100000:1.0:1785393918.525606:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807264384 00000100:00100000:1.0:1785393918.525640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:1.0:1785393918.525648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11589:x1872120807264384:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:1.0:1785393918.525845:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1785393918.525897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11589:x1872120807264384:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 249us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.525904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:0.0:1785393918.576762:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.577090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807264512 00000100:00100000:1.0:1785393918.577100:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807264512 00000100:00100000:1.0:1785393918.577312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:1.0:1785393918.577324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+25:11592:x1872120807264512:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785393918.577346:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785393918.577365:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd979 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577426:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577440:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577450:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577481:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577488:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577495:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577798:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577810:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 26 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577819:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577850:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 26 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.577864:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 26 pid: 10972 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.577878:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831372544:192.168.203.12@tcp:104: 00000100:00100000:1.0:1785393918.577978:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785393918.587861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393918.587959:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807264768 00000100:00100000:2.0:1785393918.587968:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807264768 00000100:00100000:2.0:1785393918.588040:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1785393918.588050:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:5579:x1872120807264768:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1785393918.588442:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:5579:x1872120807264768:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 392us (587us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1785393918.588450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1785393918.588540:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1872120831372544:192.168.203.12@tcp:104: 00010000:00010000:1.0:1785393918.588566:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393918.603876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393918.604084:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807264896 00000100:00100000:1.0:1785393918.604094:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807264896 00010000:00010000:1.0:1785393918.604132:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 28 pid: 10972 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785393918.604187:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1785393918.604198:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:2359:x1872120807264896:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785393918.604212:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393918.604229:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 28 pid: 10972 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604243:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 28 pid: 10972 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604265:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a875 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd93a expref: 28 pid: 10972 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604282:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393918.604287:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604296:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604304:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393918.604337:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393918.604401:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:2359:x1872120807264896:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 205us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393918.604408:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00010000:00010000:2.0:1785393918.604517:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604525:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393918.604564:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1785393918.604605:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785393918.604627:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604640:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604648:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604655:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604662:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604668:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393918.604672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604688:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604696:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:2.0:1785393918.604699:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393918.604703:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604709:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba600/0xcc9b96d8b362a95c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604720:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604725:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604730:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604735:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bae00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393918.604738:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604744:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604751:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93acc3c44500) 00010000:00010000:2.0:1785393918.604753:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785393918.604756:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604771:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bae00/0xcc9b96d8b362a963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604807:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82ba200/0xcc9b96d8b362a955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd979 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604820:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd979 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393918.604828:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393918.604830:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785393918.604833:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb000, rc 0) 00000100:00100000:2.0:1785393918.604861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11592:x1872120807264512:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 27540us (28295us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393918.604867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00010000:00010000:1.0:1785393919.073741:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785393919.521836:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785393919.521847:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785393919.521914:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1785393919.521921:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785393919.522061:0:11576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9602d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831372672:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785393919.522168:0:11576:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1785393919.549979:0:11576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9602d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11576:1872120831372672:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785393919.550306:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393919.550349:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807265024 00000100:00100000:1.0:1785393919.550358:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807265024 00000100:00100000:1.0:1785393919.550426:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:1.0:1785393919.550439:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11604:x1872120807265024:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785393919.550483:0:5832:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785393919.550608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11604:x1872120807265024:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393919.550616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00080000:1.0:1785393919.550639:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393919.583791:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393919.583871:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807265280 00000100:00100000:0.0:1785393919.583883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807265280 00000100:00100000:0.0:1785393919.583953:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:0.0:1785393919.583965:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+26:11604:x1872120807265280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785393919.583991:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785393919.584017:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362a971 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd980 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.584154:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.584172:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.584186:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785393919.584200:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1785393919.584370:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362a971 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd980 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.584409:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd980 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.584417:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393919.584420:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785393919.584424:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59e00, rc 0) 00000100:00100000:0.0:1785393919.584491:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11604:x1872120807265280:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 528us (712us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1785393919.584499:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:1.0:1785393919.589084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393919.589208:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807265408 00000100:00100000:0.0:1785393919.589229:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807265408 00000100:00100000:0.0:1785393919.589310:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1785393919.589331:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8529450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:2359:x1872120807265408:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785393919.589353:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393919.589383:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59e00/0xcc9b96d8b362a978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd980 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393919.589404:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:0.0:1785393919.589410:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393919.599206:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8529450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:2359:x1872120807265408:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 9870us (10119us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393919.599233:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1785393919.610417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393919.610826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807265664 00000100:00100000:2.0:1785393919.610837:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807265664 00000100:00100000:2.0:1785393919.610900:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1785393919.610911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+27:11604:x1872120807265664:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785393919.611008:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.611030:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.611142:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.613265:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.613282:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.613289:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.613295:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393919.613300:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.613307:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.614179:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393919.614184:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785393919.614191:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393919.614198:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362a986 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393919.615307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11604:x1872120807265664:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 4390us (4895us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1785393919.616521:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000040:00080000:2.0:1785393919.616765:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785393919.616771:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785393919.617274:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1785393919.617299:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785393919.624643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393919.650209:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807265920 00000100:00100000:1.0:1785393919.650235:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807265920 00000100:00100000:1.0:1785393919.659225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1785393919.659250:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+28:11604:x1872120807265920:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785393919.659601:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11604:x1872120807265920:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 360us (34973us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1785393919.659611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000001:00080000:2.0:1785393919.681443:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1785393919.681472:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1785393919.681479:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1785393920.100291:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785393920.421757:0:12355:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785393920.421768:0:12355:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785393920.421843:0:12355:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1785393920.421875:0:12355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785393920.867364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393920.867411:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266176 00000100:00100000:2.0:1785393920.867423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266176 00000100:00100000:2.0:1785393920.867488:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1785393920.867500:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+29:11617:x1872120807266176:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1785393920.867533:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785393920.867559:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a98d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd987 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.867715:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a994 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.867733:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.867746:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785393920.867759:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1785393920.867915:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a98d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd987 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.867935:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd987 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.867967:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393920.867970:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1785393920.867974:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1800, rc 0) 00000100:00100000:2.0:1785393920.868052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11617:x1872120807266176:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 554us (699us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1785393920.868060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:3.0:1785393920.902390:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393920.905354:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266304 00000100:00100000:2.0:1785393920.905371:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266304 00000100:00100000:2.0:1785393920.905454:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:2.0:1785393920.905465:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11617:x1872120807266304:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1785393920.905560:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905608:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905623:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905658:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905666:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905673:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905679:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785393920.905692:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905701:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905714:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:2.0:1785393920.905717:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785393920.905722:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393920.905727:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362a9a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785393920.905821:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:11617:x1872120807266304:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 357us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393920.905830:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00010000:00010000:3.0:1785393921.119908:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393921.125786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393921.125898:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266432 00000100:00100000:3.0:1785393921.125909:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266432 00000100:00100000:3.0:1785393921.125992:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00080000:1.0:1785393921.125997:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393921.126006:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807266432:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1785393921.126031:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393921.126058:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cfae53d/0xcc9b96d8b362a9a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd98e expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785393921.126093:0:6632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a6af2fc, atime: 0x6a6af2fb, ctime: 0x6a6af2fc, blocks: 0xb 00010000:00010000:3.0:1785393921.126121:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1785393921.126143:0:6632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785393921.126156:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfae53d/0xcc9b96d8b362a9a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd98e expref: 8 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393921.126179:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cfae53d/0xcc9b96d8b362a9a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd98e expref: 8 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393921.126195:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785393921.126278:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2360:x1872120807266432:12345-192.168.203.12@tcp:101:cat.0 Request processed in 275us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393921.126286:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1785393921.137974:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393921.138095:0:6637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266560 00000100:00100000:3.0:1785393921.138108:0:6637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266560 00002000:00100000:3.0:1785393921.138171:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93acff949f80 x1872120807266560/t0(0) o3->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:132/0 lens 488/0 e 0 to 0 dl 1785393932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393921.138184:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff949f80 with x1872120807266560 ext(0->4095) 00002000:00010000:3.0:1785393921.138191:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acff949f80 00000100:00100000:3.0:1785393921.138235:0:6637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1785393921.138245:0:6637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2361:x1872120807266560:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:3.0:1785393921.138732:0:6637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2361:x1872120807266560:12345-192.168.203.12@tcp:3:cat.0 Request processed in 487us (770us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785393921.138741:0:6637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:3.0:1785393921.138749:0:6637:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93acff949f80 x1872120807266560/t0(0) o3->cdff80e6-0298-4ec3-bd74-9f3c38d2038e@192.168.203.12@tcp:132/0 lens 488/4536 e 0 to 0 dl 1785393932 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785393921.138758:0:6637:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93acff949f80 with x1872120807266560 ext(0->4095) 00002000:00010000:3.0:1785393921.138777:0:6637:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93acff949f80 00000100:00100000:0.0:1785393921.567979:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831373056:0@lo:400:kworker.0 00000100:00100000:0.0:1785393921.568077:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393921.568168:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393921.568174:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831373184:0@lo:400:kworker.0 00000100:00100000:0.0:1785393921.568211:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393921.568507:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831372928:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.568539:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393921.568603:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831373440:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.568624:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393921.568648:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785393921.568653:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831372800:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.568683:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393921.568702:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831373312:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.568732:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393921.568765:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373184 00000100:00100000:3.0:1785393921.568775:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373184 00000100:00100000:3.0:1785393921.568898:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373440 00000100:00100000:3.0:1785393921.568902:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373440 00000100:00100000:3.0:1785393921.568935:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1785393921.568944:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1872120831373184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.569006:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1872120831373184:12345-0@lo:400:kworker.0 Request processed in 62us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393921.569014:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1785393921.569124:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1785393921.569131:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831373440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.569165:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831373440:12345-0@lo:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393921.569171:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1785393921.569190:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831372800 00000100:00100000:3.0:1785393921.569193:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831372800 00000100:00100000:3.0:1785393921.569242:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1785393921.569338:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373056 00000100:00100000:2.0:1785393921.569342:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373056 00000100:00100000:2.0:1785393921.569376:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831372928 00000100:00100000:2.0:1785393921.569379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831372928 00000100:00100000:2.0:1785393921.569391:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373312 00000100:00100000:2.0:1785393921.569392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373312 00000100:00100000:2.0:1785393921.569404:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1785393921.569410:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831373056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393921.569442:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831373056:12345-0@lo:400:kworker.0 Request processed in 33us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393921.569447:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1785393921.569466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1785393921.569471:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831372928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393921.569496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831372928:12345-0@lo:400:kworker.0 Request processed in 24us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393921.569500:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1785393921.569509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1785393921.569513:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831373312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393921.569533:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831373312:12345-0@lo:400:kworker.0 Request processed in 19us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393921.569538:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1785393921.569909:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831373312:0@lo:400:kworker.0 00000100:00080000:1.0:1785393921.570185:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393921.570192:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785393921.570194:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393921.570237:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831373184:0@lo:400:kworker.0 00000100:00100000:1.0:1785393921.570256:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831373056:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.571138:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831372800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.571221:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831372800:12345-0@lo:400:kworker.0 Request processed in 94us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393921.571935:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831372928:0@lo:400:kworker.0 00000100:00100000:2.0:1785393921.571948:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1785393921.571954:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1785393921.571971:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acff96ea00, transno 4294967310 00000100:00100000:2.0:1785393921.571985:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831373440:0@lo:400:kworker.0 00000100:00100000:2.0:1785393921.572003:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831372800:0@lo:400:kworker.0 00000100:00100000:3.0:1785393921.582859:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1785393922.080973:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393922.081013:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831373568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393922.081924:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393922.082063:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373568 00000100:00100000:1.0:1785393922.082083:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373568 00000100:00100000:1.0:1785393922.082152:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1785393922.082164:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831373568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393922.082220:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393922.082271:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831373568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393922.082278:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1785393922.088166:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831373568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393922.144404:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393922.593251:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831373696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393922.593355:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393922.593494:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373696 00000100:00100000:0.0:1785393922.593504:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373696 00000100:00100000:0.0:1785393922.593558:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1785393922.593582:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831373696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785393922.593628:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000004:00080000:3.0:1785393922.594055:0:6674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454625483785ns, next at 455625480692ns, rc = 0 00000100:00100000:0.0:1785393922.607237:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1872120831373696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13650us (13862us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393922.607255:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785393922.608985:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831373696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785393923.169202:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393923.274790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393923.275006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393923.275038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393923.275099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393923.275134:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266816 00000100:00100000:0.0:1785393923.275143:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266816 00000100:00100000:0.0:1785393923.275213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:0.0:1785393923.275224:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:2358:x1872120807266816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393923.275300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+31:2358:x1872120807266816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393923.275307:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1785393923.275398:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266688 00000100:00100000:2.0:1785393923.275403:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266688 00000100:00100000:2.0:1785393923.275436:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:2.0:1785393923.275442:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807266688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393923.275469:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807266688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393923.275475:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 323 00000100:00100000:3.0:1785393923.278795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393923.280362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267200 00000100:00100000:0.0:1785393923.280372:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267200 00000100:00100000:0.0:1785393923.280426:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:0.0:1785393923.280435:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807267200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393923.280499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2359:x1872120807267200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393923.280506:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00080000:0.0:1785393923.282792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393923.283397:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807266944 00000100:00100000:1.0:1785393923.283405:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807266944 00000100:00080000:0.0:1785393923.283480:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785393923.283597:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267072 00000100:00100000:1.0:1785393923.283601:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267072 00000100:00080000:0.0:1785393923.283643:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785393923.283719:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1785393923.283729:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807266944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393923.283788:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+8:2358:x1872120807266944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 60us (8748us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393923.283794:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1785393923.283809:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1785393923.283815:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807267072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393923.284097:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807267072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 282us (8997us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393923.284105:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000001:00080000:0.0:1785393923.725866:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1785393923.725882:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1785393923.731018:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:3.0:1785393923.731031:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1785393923.731043:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1785393923.731055:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acc517f000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1785393923.731061:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acff95d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acc517f780 00000020:00080000:3.0:1785393923.731064:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acff95dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93acf88e7000 00000004:00080000:3.0:1785393923.731086:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:3.0:1785393923.731102:0:5853:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1785393923.731216:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393923.731233:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831373824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785393923.731297:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393923.731359:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373824 00000100:00100000:3.0:1785393923.731365:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373824 00000100:00100000:3.0:1785393923.731414:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785393923.731423:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831373824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1785393923.731641:0:6632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1785393923.731656:0:6632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1785393916 -> 1785393916 00002000:00010000:3.0:1785393923.731659:0:6632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1785393915 -> 1785393915 00002000:00010000:3.0:1785393923.731661:0:6632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1785393916 -> 1785393916 00002000:00010000:3.0:1785393923.731663:0:6632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1785393923.731703:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831373824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (405us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1785393923.731709:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1785393923.731727:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785393923.731750:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1785393923.731755:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acff96ed80, transno 4294967321 00000004:00080000:3.0:1785393923.731762:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1785393923.731781:0:3316:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93acf7d48a80 x1872120831373824/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1785393939 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1785393923.731792:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93acf7d48a80/2, rc 0, transno 4294967324 00000100:00100000:3.0:1785393923.731796:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831373824:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1785393923.731988:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1785393923.732135:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1785393924.191970:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393925.221515:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393926.240662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393926.687975:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831373952:0@lo:400:kworker.0 00000100:00100000:2.0:1785393926.687991:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831374336:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.688047:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831374080:0@lo:400:kworker.0 00000100:00100000:2.0:1785393926.688075:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393926.688076:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393926.688092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393926.688143:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374336 00000100:00100000:0.0:1785393926.688152:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374336 00000100:00100000:3.0:1785393926.688156:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831374464:0@lo:400:kworker.0 00000100:00100000:0.0:1785393926.688230:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1785393926.688241:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831374336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393926.693661:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831374208:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.694182:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831374592:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.694223:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393926.694273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374080 00000100:00100000:1.0:1785393926.694284:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374080 00000100:00100000:1.0:1785393926.694609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1785393926.694621:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831374080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.694691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831374080:12345-0@lo:400:kworker.0 Request processed in 72us (6596us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393926.694699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1785393926.694746:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831374080:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.694801:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831373952 00000100:00100000:1.0:1785393926.694805:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831373952 00000100:00100000:1.0:1785393926.694833:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1785393926.694840:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831373952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.695606:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831373952:12345-0@lo:400:kworker.0 Request processed in 765us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393926.695615:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:1.0:1785393926.695663:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393926.696444:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393926.697438:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374592 00000100:00100000:2.0:1785393926.697446:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374592 00000100:00100000:2.0:1785393926.697499:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1785393926.697508:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831374592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393926.697589:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831374592:12345-0@lo:400:kworker.0 Request processed in 82us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393926.697596:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1785393926.697641:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831374592:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.697744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374208 00000100:00100000:1.0:1785393926.697749:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374208 00000100:00100000:1.0:1785393926.697793:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1785393926.697802:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831374208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.697859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831374208:12345-0@lo:400:kworker.0 Request processed in 59us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393926.697867:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1785393926.697885:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831374208:0@lo:400:kworker.0 00000100:00080000:1.0:1785393926.697890:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785393926.697896:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393926.703476:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393926.703622:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831373952:0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.703680:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374464 00000100:00100000:1.0:1785393926.703695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374464 00000100:00100000:1.0:1785393926.703776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1785393926.703786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393926.703883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831374464:12345-0@lo:400:kworker.0 Request processed in 99us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393926.703892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1785393926.703980:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393926.704094:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831374464:0@lo:400:kworker.0 00000100:00100000:0.0:1785393926.708655:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831374336:12345-0@lo:400:kworker.0 Request processed in 20402us (20571us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393926.708672:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1785393926.711709:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831374336:0@lo:400:kworker.0 00000100:00100000:0.0:1785393927.205344:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785393927.205375:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831374720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393927.205463:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393927.209272:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374720 00000100:00100000:1.0:1785393927.209290:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374720 00000100:00100000:1.0:1785393927.209369:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785393927.209380:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831374720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393927.209438:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393927.209551:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831374720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393927.209559:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785393927.211340:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831374720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393927.273364:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393927.712842:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831374848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393927.712936:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393927.713128:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374848 00000100:00100000:3.0:1785393927.713151:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374848 00000100:00100000:3.0:1785393927.713223:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1785393927.713234:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831374848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393927.713281:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393927.713357:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1872120831374848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393927.713365:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1785393927.713921:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831374848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393928.293086:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393928.396056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393928.396106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393928.396245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393928.396279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393928.396317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393928.396368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267328 00000100:00100000:1.0:1785393928.396379:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267328 00000100:00100000:1.0:1785393928.396438:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:1.0:1785393928.396451:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807267328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393928.396533:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2360:x1872120807267328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393928.396541:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:3.0:1785393928.407646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267840 00000100:00100000:3.0:1785393928.407666:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267840 00000100:00100000:3.0:1785393928.407743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267456 00000100:00100000:3.0:1785393928.407747:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267456 00000100:00100000:3.0:1785393928.407783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1785393928.407795:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807267840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393928.407894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2360:x1872120807267840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (11649us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393928.407903:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:3.0:1785393928.407923:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1785393928.407930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2360:x1872120807267456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393928.407959:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2360:x1872120807267456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (11679us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393928.407966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1785393928.408822:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267584 00000100:00100000:2.0:1785393928.408831:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267584 00000100:00100000:2.0:1785393928.408879:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267712 00000100:00100000:2.0:1785393928.408895:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267712 00000100:00100000:2.0:1785393928.408924:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1785393928.408933:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807267584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393928.408974:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2360:x1872120807267584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (12869us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393928.409427:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:2.0:1785393928.409447:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:2.0:1785393928.409467:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807267712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393928.409497:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2360:x1872120807267712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (13180us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393928.409504:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00080000:3.0:1785393928.413636:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393928.413648:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393928.413652:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785393928.837770:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:3.0:1785393928.847277:0:5853:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1785393928.847337:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1785393928.847359:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1785393928.858630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393928.858679:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807267968 00000100:00100000:3.0:1785393928.858693:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807267968 00000100:00100000:3.0:1785393928.858767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1785393928.858779:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11277:x1872120807267968:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1785393928.858916:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11277:x1872120807267968:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 138us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393928.858924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1785393928.863739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000040:00080000:2.0:1785393928.863986:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785393928.863992:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785393928.864356:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1785393928.864364:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785393928.864482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268224 00000100:00100000:0.0:1785393928.864494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268224 00000100:00100000:0.0:1785393928.864554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:0.0:1785393928.864566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:11277:x1872120807268224:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785393928.865063:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:11277:x1872120807268224:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 497us (1336us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1785393928.865071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:3.0:1785393929.311822:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393929.452300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393929.452412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268352 00000100:00100000:3.0:1785393929.452424:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268352 00000100:00100000:3.0:1785393929.452499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:3.0:1785393929.452512:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:12069:x1872120807268352:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:3.0:1785393929.452540:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785393929.452566:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a9b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd995 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.452676:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.452693:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.452706:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785393929.453054:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785393929.453060:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1785393929.453155:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.453190:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362a9b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd995 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.453211:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd995 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393929.453222:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:3.0:1785393929.453225:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785393929.453229:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0200, rc 0) 00000100:00100000:3.0:1785393929.453308:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:12069:x1872120807268352:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 799us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393929.453316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00010000:00010000:3.0:1785393930.335883:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393931.361114:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393931.808418:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831375232:0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.808537:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393931.808657:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785393931.808668:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831375104:0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.808702:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393931.808722:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831375616:0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.808746:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393931.808797:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375616 00000100:00100000:3.0:1785393931.808807:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375616 00000100:00100000:3.0:1785393931.808875:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1785393931.808899:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.808963:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831375616:12345-0@lo:400:kworker.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393931.808971:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1785393931.808996:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785393931.809014:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375232 00000100:00100000:3.0:1785393931.809018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375232 00000100:00100000:3.0:1785393931.809048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375104 00000100:00100000:3.0:1785393931.809051:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375104 00000100:00100000:3.0:1785393931.809069:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1785393931.809075:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831375232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.809120:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831375232:12345-0@lo:400:kworker.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393931.809126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1785393931.809148:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1785393931.809155:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831375104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.809184:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831375104:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393931.809189:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1785393931.809203:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393931.809237:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831375104:0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.809248:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf8aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831375616:0@lo:400:kworker.0 00000100:00100000:3.0:1785393931.809256:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831375232:0@lo:400:kworker.0 00000100:00100000:0.0:1785393931.809439:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831374976:0@lo:400:kworker.0 00000100:00100000:0.0:1785393931.809477:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393931.809517:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831375488:0@lo:400:kworker.0 00000100:00100000:0.0:1785393931.809538:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393931.809567:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785393931.809591:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831375360:0@lo:400:kworker.0 00000100:00100000:0.0:1785393931.809615:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393931.809640:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375488 00000100:00100000:0.0:1785393931.809644:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375488 00000100:00100000:0.0:1785393931.809681:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1785393931.809687:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831375488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393931.809736:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831375488:12345-0@lo:400:kworker.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393931.809742:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1785393931.809758:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393931.809778:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831375488:0@lo:400:kworker.0 00000100:00100000:1.0:1785393931.809847:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831374976 00000100:00100000:1.0:1785393931.809851:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831374976 00000100:00100000:1.0:1785393931.809892:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1785393931.809899:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831374976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393931.809941:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831374976:12345-0@lo:400:kworker.0 Request processed in 43us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393931.809957:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1785393931.809992:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831374976:0@lo:400:kworker.0 00000100:00100000:2.0:1785393931.814344:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375360 00000100:00100000:2.0:1785393931.814361:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375360 00000100:00100000:2.0:1785393931.814476:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1785393931.814490:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831375360:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785393931.814567:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393931.814752:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831375360:12345-0@lo:400:kworker.0 Request processed in 265us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393931.814760:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1785393931.815336:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1785393931.815344:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93acf7d48a80, transno 4294967324 00000100:00100000:1.0:1785393931.815370:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831375360:0@lo:400:kworker.0 00000100:00100000:0.0:1785393932.321001:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831375744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785393932.321093:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393932.321391:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375744 00000100:00100000:1.0:1785393932.321401:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375744 00000100:00100000:1.0:1785393932.321458:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785393932.321469:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831375744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393932.321514:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393932.339151:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831375744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17659us (18035us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393932.339171:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785393932.344339:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831375744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393932.389907:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393932.831894:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831375872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393932.832008:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393932.832172:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831375872 00000100:00100000:3.0:1785393932.832183:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831375872 00000100:00100000:3.0:1785393932.832264:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1785393932.832276:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831375872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393932.832321:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393932.832398:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831375872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393932.832406:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785393932.835748:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831375872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785393933.407921:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393933.517183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393933.517237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393933.517282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393933.517309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393933.517340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393933.517377:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268864 00000100:00100000:2.0:1785393933.517388:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268864 00000100:00100000:2.0:1785393933.517449:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268736 00000100:00100000:2.0:1785393933.517469:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268736 00000100:00100000:2.0:1785393933.517494:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1785393933.517505:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807268864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393933.517626:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2358:x1872120807268864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 122us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393933.517634:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1785393933.517653:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:2.0:1785393933.517660:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807268736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785393933.517687:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807268736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00080000:0.0:1785393933.517863:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785393933.517868:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785393933.517880:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268608 00000100:00100000:0.0:1785393933.517884:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268608 00000100:00100000:0.0:1785393933.517917:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268992 00000100:00100000:0.0:1785393933.517920:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268992 00000100:00100000:0.0:1785393933.517939:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1785393933.517946:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2358:x1872120807268608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393933.518002:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:2358:x1872120807268608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 47us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393933.518017:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1785393933.518031:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:0.0:1785393933.518037:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2358:x1872120807268992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393933.518061:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2358:x1872120807268992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393933.518068:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00080000:0.0:1785393933.518087:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785393933.518687:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:1.0:1785393933.519094:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807268480 00000100:00100000:1.0:1785393933.519100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807268480 00000100:00100000:1.0:1785393933.519153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:1.0:1785393933.519161:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807268480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393933.519206:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807268480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393933.519212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 327 00000001:00080000:3.0:1785393934.096762:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1785393934.441822:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785393935.259259:0:12559:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:45:32 (1785393932) 00010000:00010000:3.0:1785393935.457046:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393936.480670:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393936.928752:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831376128:0@lo:400:kworker.0 00000100:00100000:2.0:1785393936.928820:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393936.928869:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831376640:0@lo:400:kworker.0 00000100:00100000:2.0:1785393936.928895:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393936.928923:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393936.928928:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831376256:0@lo:400:kworker.0 00000100:00100000:2.0:1785393936.928947:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393936.929175:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831376000:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929207:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393936.929247:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831376512:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929324:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393936.929342:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785393936.929347:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf963ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831376384:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929365:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393936.929388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376128 00000100:00100000:3.0:1785393936.929394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376128 00000100:00100000:3.0:1785393936.929428:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376256 00000100:00100000:3.0:1785393936.929430:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376256 00000100:00100000:3.0:1785393936.929446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376512 00000100:00100000:3.0:1785393936.929448:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376512 00000100:00100000:3.0:1785393936.929473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1785393936.929480:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831376128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929527:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831376128:12345-0@lo:400:kworker.0 Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393936.929534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1785393936.929548:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1785393936.929553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831376256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929667:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831376256:12345-0@lo:400:kworker.0 Request processed in 112us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393936.929673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1785393936.929684:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1785393936.929690:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831376512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929722:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831376512:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393936.929727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1785393936.929746:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376640 00000100:00100000:3.0:1785393936.929749:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376640 00000100:00100000:3.0:1785393936.929774:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376384 00000100:00100000:3.0:1785393936.929777:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376384 00000100:00100000:3.0:1785393936.929797:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1785393936.929803:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf963ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831376640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929837:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf963ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831376640:12345-0@lo:400:kworker.0 Request processed in 34us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393936.929842:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1785393936.929854:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1785393936.929859:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831376384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929899:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831376384:12345-0@lo:400:kworker.0 Request processed in 40us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393936.929905:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1785393936.929923:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785393936.929927:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785393936.929929:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393936.929954:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831376384:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929965:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831376512:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.929998:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831376256:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.930008:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831376128:0@lo:400:kworker.0 00000100:00100000:3.0:1785393936.930016:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831376640:0@lo:400:kworker.0 00000100:00100000:2.0:1785393936.933450:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376000 00000100:00100000:2.0:1785393936.933462:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376000 00000100:00100000:2.0:1785393936.933521:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1785393936.933530:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831376000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393936.933627:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831376000:12345-0@lo:400:kworker.0 Request processed in 98us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393936.933634:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1785393936.933699:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf963d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831376000:0@lo:400:kworker.0 00000100:00100000:3.0:1785393937.453027:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831376768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785393937.453107:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393937.453522:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376768 00000100:00100000:2.0:1785393937.453530:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376768 00000100:00100000:2.0:1785393937.453607:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1785393937.453617:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831376768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785393937.453651:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785393937.466786:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831376768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13161us (13679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393937.466801:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1785393937.470072:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831376768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785393937.511506:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785393937.962929:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393937.962951:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831376896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785393937.963030:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393937.963191:0:8170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831376896 00000100:00100000:3.0:1785393937.963199:0:8170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831376896 00000100:00100000:3.0:1785393937.963247:0:8170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785393937.963256:0:8170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831376896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393937.963287:0:8170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393937.963340:0:8170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831376896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393937.963347:0:8170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1785393937.963423:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831376896:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1785393938.083334:0:11576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785393938.083344:0:11576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785393938.083756:0:11576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1785393938.083762:0:11576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1785393938.528228:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393938.638457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393938.638502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393938.638536:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393938.638622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393938.638651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393938.638725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269248 00000100:00100000:0.0:1785393938.638734:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269248 00000100:00100000:0.0:1785393938.638794:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269632 00000100:00100000:0.0:1785393938.638797:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269632 00000100:00100000:0.0:1785393938.638822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:0.0:1785393938.638831:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2358:x1872120807269248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393938.638901:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:2358:x1872120807269248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393938.638909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:0.0:1785393938.638936:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:0.0:1785393938.638942:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2361:x1872120807269632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785393938.638973:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2361:x1872120807269632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393938.638978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:3.0:1785393938.639343:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269376 00000100:00100000:3.0:1785393938.639348:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269376 00000100:00100000:3.0:1785393938.639381:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269504 00000100:00100000:3.0:1785393938.639384:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269504 00000100:00100000:3.0:1785393938.639401:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1785393938.639407:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff96ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807269376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785393938.639440:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff96ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2358:x1872120807269376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393938.639445:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:3.0:1785393938.639456:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:3.0:1785393938.639462:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+5:2357:x1872120807269504:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1785393938.639477:0:6631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362a3ac 00000100:00080000:3.0:1785393938.639484:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acc8869800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393938.639512:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1785393938.639747:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807269504:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 284us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393938.639754:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:3.0:1785393938.639808:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393938.639903:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393938.639907:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785393938.639909:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393938.640152:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269120 00000100:00100000:1.0:1785393938.640157:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269120 00000100:00100000:1.0:1785393938.640219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:1.0:1785393938.640226:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807269120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785393938.640263:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2358:x1872120807269120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393938.640270:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 329 00010000:00010000:1.0:1785393939.551898:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785393940.083506:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:1.0:1785393940.083517:0:7533:0:(genops.c:906:class_export_put()) final put ffff93acc886d000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:2.0:1785393940.083592:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc886d000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0001 00000020:00000080:2.0:1785393940.083651:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc8869800 for lustre-OST0001 00010000:00010000:3.0:1785393940.577266:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393940.751103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393940.751201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807269888 00000100:00100000:1.0:1785393940.751213:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807269888 00000100:00100000:1.0:1785393940.751296:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1785393940.751310:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+18:12291:x1872120807269888:12345-192.168.203.12@tcp:35:umount.0 00000100:00080000:2.0:1785393940.751317:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393940.751957:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:12291:x1872120807269888:12345-192.168.203.12@tcp:35:umount.0 Request processed in 651us (866us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1785393940.751965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:3.0:1785393940.759119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393940.759266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807270144 00000100:00100000:1.0:1785393940.759280:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807270144 00000100:00100000:1.0:1785393940.759349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1785393940.759360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+19:12291:x1872120807270144:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:1.0:1785393940.759805:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:12291:x1872120807270144:12345-192.168.203.12@tcp:35:umount.0 Request processed in 446us (699us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1785393940.759814:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1785393940.769643:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393940.769755:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807270400 00000100:00100000:0.0:1785393940.769768:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807270400 00000100:00100000:0.0:1785393940.769837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1785393940.769864:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc7de8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+20:12291:x1872120807270400:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:0.0:1785393940.770444:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc7de8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:12291:x1872120807270400:12345-192.168.203.12@tcp:35:umount.0 Request processed in 579us (811us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1785393940.770453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1785393940.773422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785393940.773494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807270656 00000100:00100000:1.0:1785393940.773502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807270656 00000100:00100000:1.0:1785393940.773562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1785393940.773608:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+21:12291:x1872120807270656:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:1.0:1785393940.773928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:12291:x1872120807270656:12345-192.168.203.12@tcp:35:umount.0 Request processed in 355us (514us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1785393940.773936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1785393940.778970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393940.779002:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393940.779026:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393940.779158:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807270784 00000100:00100000:2.0:1785393940.779167:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807270784 00000100:00100000:2.0:1785393940.779217:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807271040 00000100:00100000:2.0:1785393940.779220:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807271040 00000100:00100000:2.0:1785393940.779231:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807270912 00000100:00100000:2.0:1785393940.779233:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807270912 00000100:00100000:2.0:1785393940.779247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785393940.779256:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+15:2359:x1872120807270784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393940.779278:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393940.779295:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0045a00/0xcc9b96d8b3629a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd520 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393940.779310:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393940.779352:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+14:2359:x1872120807270784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 97us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393940.779359:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785393940.779374:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1785393940.779379:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+13:2359:x1872120807271040:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393940.779387:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393940.779394:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f1200/0xcc9b96d8b3629c12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5eb expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393940.779402:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393940.779417:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:2359:x1872120807271040:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393940.779423:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1785393940.779433:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1785393940.779439:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2359:x1872120807270912:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785393940.779446:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785393940.779453:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1600/0xcc9b96d8b362998e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd4e8 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393940.779460:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785393940.779477:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2359:x1872120807270912:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393940.779487:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1785393940.784367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785393940.784452:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807271424 00000100:00100000:0.0:1785393940.784461:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807271424 00000100:00100000:0.0:1785393940.784525:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00080000:2.0:1785393940.784530:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393940.784534:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2357:x1872120807271424:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:0.0:1785393940.784559:0:6631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629f61 00000020:00010000:0.0:1785393940.784566:0:6631:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93acd80ef000: total 0 00000100:00080000:0.0:1785393940.784601:0:6631:0:(import.c:65:import_set_state_nolock()) ffff93acd80ed000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1785393940.784626:0:7522:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93acd80ef000: total 0 00000001:00000004:0.0:1785393940.784633:0:6631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1785393940.784654:0:7522:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93acd80ef000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1785393940.784699:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2bced6a/0xcc9b96d8b362a304 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7c0 expref: 6 pid: 6630 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393940.784728:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cfae53d/0xcc9b96d8b362a9a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd98e expref: 5 pid: 6632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393940.784740:0:7522:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93acd80ef000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1785393940.784750:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393940.784752:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393940.784753:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393940.784869:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+2:2357:x1872120807271424:12345-192.168.203.12@tcp:9:umount.0 Request processed in 335us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393940.784876:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1785393940.799435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393940.799514:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807272448 00000100:00100000:3.0:1785393940.799523:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807272448 00000100:00100000:3.0:1785393940.799595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:3.0:1785393940.799603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+22:2357:x1872120807272448:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:3.0:1785393940.799632:0:5831:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362999c 00000020:00010000:3.0:1785393940.799647:0:5831:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93abc2044000: total 0 00000100:00080000:3.0:1785393940.799650:0:5831:0:(import.c:65:import_set_state_nolock()) ffff93abc2046000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393940.799671:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1785393940.800133:0:5820:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93abc2044000: total 0 00010000:00010000:1.0:1785393940.800179:0:5820:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93abc2044000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1785393940.800210:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:1.0:1785393940.800214:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393940.800221:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045000/0xcc9b96d8b362a366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7dc expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800239:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393940.800242:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393940.800246:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045200/0xcc9b96d8b362a2c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7ab expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800258:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393940.800260:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785393940.800264:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb000/0xcc9b96d8b362a96a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd979 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800277:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393940.800279:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785393940.800282:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0e00/0xcc9b96d8b362a668 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd8b5 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800311:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393940.800314:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785393940.800317:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1800/0xcc9b96d8b362a994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd987 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800329:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393940.800331:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785393940.800335:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b3629fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd6e7 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800345:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acc7d14600) 00010000:00010000:1.0:1785393940.800347:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785393940.800350:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045400/0xcc9b96d8b3629c66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5f9 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800365:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393940.800367:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785393940.800371:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044a00/0xcc9b96d8b362a2ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7b9 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800382:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93acd96a4600) 00010000:00010000:1.0:1785393940.800384:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393940.800387:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acc82bb200/0xcc9b96d8b362a1e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd773 expref: 13 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800399:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93acc89f9700) 00010000:00010000:1.0:1785393940.800401:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785393940.800410:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1200/0xcc9b96d8b3629cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd615 expref: 12 pid: 10972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800424:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93acc89f9800) 00010000:00010000:1.0:1785393940.800426:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785393940.800429:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0044600/0xcc9b96d8b362a88a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd941 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800441:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93acc89f9200) 00010000:00010000:1.0:1785393940.800443:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785393940.800446:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0400/0xcc9b96d8b362a382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd7e3 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800459:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acc7d14100) 00010000:00010000:1.0:1785393940.800461:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785393940.800464:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace0045600/0xcc9b96d8b3629c82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd600 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393940.800475:0:5820:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93abc2044000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1785393940.800488:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393940.800489:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393940.800491:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393940.800595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdff80e6-0298-4ec3-bd74-9f3c38d2038e+7:2357:x1872120807272448:12345-192.168.203.12@tcp:39:umount.0 Request processed in 990us (1166us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1785393940.800603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00010000:00010000:3.0:1785393941.599840:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393942.047986:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831377152:0@lo:400:kworker.0 00000100:00100000:1.0:1785393942.047986:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831377024:0@lo:400:kworker.0 00000100:00100000:3.0:1785393942.048054:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831377408:0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.054249:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393942.054332:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831377664:0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.054361:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393942.054390:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393942.054395:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831377280:0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.054413:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393942.054601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377152 00000100:00100000:0.0:1785393942.054609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377152 00000100:00100000:0.0:1785393942.054645:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377280 00000100:00100000:0.0:1785393942.054648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377280 00000100:00100000:0.0:1785393942.054674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1785393942.054682:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831377152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393942.054737:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831377152:12345-0@lo:400:kworker.0 Request processed in 56us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393942.054744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1785393942.054760:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785393942.054778:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831377280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393942.054808:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831377280:12345-0@lo:400:kworker.0 Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393942.054814:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785393942.054834:0:8307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377664 00000100:00100000:0.0:1785393942.054837:0:8307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377664 00000100:00100000:0.0:1785393942.054863:0:8307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1785393942.054870:0:8307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831377664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785393942.054905:0:8307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831377664:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393942.054911:0:8307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1785393942.054931:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785393942.054936:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785393942.054962:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831377280:0@lo:400:kworker.0 00000100:00100000:0.0:1785393942.054974:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831377152:0@lo:400:kworker.0 00000100:00100000:0.0:1785393942.054983:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831377664:0@lo:400:kworker.0 00000100:00100000:1.0:1785393942.057938:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393942.058000:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831377536:0@lo:400:kworker.0 00000100:00100000:1.0:1785393942.058037:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393942.058215:0:10972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377536 00000100:00100000:1.0:1785393942.058223:0:10972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377536 00000100:00100000:1.0:1785393942.058288:0:10972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1785393942.058297:0:10972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831377536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785393942.058344:0:10972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831377536:12345-0@lo:400:kworker.0 Request processed in 48us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393942.058351:0:10972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1785393942.058374:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785393942.058402:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831377536:0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.058547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377024 00000100:00100000:2.0:1785393942.058552:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377024 00000100:00100000:2.0:1785393942.058615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1785393942.058622:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831377024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.058658:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831377024:12345-0@lo:400:kworker.0 Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393942.058671:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1785393942.058861:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831377024:0@lo:400:kworker.0 00000100:00100000:3.0:1785393942.062265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393942.062428:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377408 00000100:00100000:0.0:1785393942.062437:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377408 00000100:00100000:0.0:1785393942.062510:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785393942.062520:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831377408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785393942.062638:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785393942.076430:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831377408:12345-0@lo:400:kworker.0 Request processed in 13903us (14161us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393942.076443:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1785393942.076634:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831377408:0@lo:400:kworker.0 00000100:00100000:2.0:1785393942.559857:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785393942.559879:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831377792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785393942.559941:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393942.560053:0:6634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377792 00000100:00100000:1.0:1785393942.560069:0:6634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377792 00000100:00100000:1.0:1785393942.560116:0:6634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1785393942.560125:0:6634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831377792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785393942.560158:0:6634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785393942.560211:0:6634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831377792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393942.560218:0:6634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1785393942.560302:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831377792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785393942.626288:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393943.072431:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831377920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785393943.072504:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393943.072725:0:6633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831377920 00000100:00100000:3.0:1785393943.072732:0:6633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831377920 00000100:00100000:3.0:1785393943.072781:0:6633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785393943.072790:0:6633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831377920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785393943.072821:0:6633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785393943.072875:0:6633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831377920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393943.072881:0:6633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785393943.073016:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831377920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785393943.194710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393943.194748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393943.194875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393943.206253:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807272576 00000100:00100000:3.0:1785393943.206265:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807272576 00000100:00100000:3.0:1785393943.206331:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807272832 00000100:00100000:3.0:1785393943.206333:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807272832 00000100:00100000:3.0:1785393943.206344:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807272704 00000100:00100000:3.0:1785393943.206346:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807272704 00000100:00100000:3.0:1785393943.206363:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785393943.206370:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+12:2360:x1872120807272576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393943.206385:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393943.206401:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0800/0xcc9b96d8b3629a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd535 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393943.206416:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393943.206463:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+11:2360:x1872120807272576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 94us (11762us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393943.206469:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785393943.206483:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1785393943.206488:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+10:2360:x1872120807272832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393943.206494:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393943.206501:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0044e00/0xcc9b96d8b3629c0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd5e4 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393943.206509:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393943.206523:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+9:2360:x1872120807272832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 35us (11775us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393943.206528:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1785393943.206536:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1785393943.206541:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+8:2360:x1872120807272704:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785393943.206546:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393943.206593:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f0e00/0xcc9b96d8b3629a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd55f expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393943.206601:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393943.206617:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+7:2360:x1872120807272704:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 76us (11742us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393943.206622:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1785393943.210633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785393943.210818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273088 00000100:00100000:3.0:1785393943.210826:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273088 00000100:00100000:3.0:1785393943.210891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:3.0:1785393943.210899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+6:2357:x1872120807273088:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:3.0:1785393943.210930:0:5831:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629a83 00000020:00010000:3.0:1785393943.210936:0:5831:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93abc125f800: total 0 00000100:00080000:3.0:1785393943.210940:0:5831:0:(import.c:65:import_set_state_nolock()) ffff93abc125d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393943.210959:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1785393943.211147:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21cecf35-5d73-4c59-b498-ba47bfa21eb7+5:2357:x1872120807273088:12345-192.168.203.12@tcp:39:umount.0 Request processed in 248us (518us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1785393943.211153:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000020:00010000:3.0:1785393943.211169:0:5820:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93abc125f800: total 0 00010000:00010000:3.0:1785393943.211172:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393943.211202:0:5820:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93abc125f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1785393943.211227:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd96a4400) 00010000:00010000:3.0:1785393943.211231:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785393943.211237:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0200/0xcc9b96d8b362a9b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd995 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393943.211255:0:5820:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93abc125f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1785393943.211262:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393943.211274:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393943.211276:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393943.211456:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785393943.247329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785393943.247411:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273344 00000100:00100000:2.0:1785393943.247419:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273344 00000100:00100000:2.0:1785393943.247465:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 331 00000100:00100000:2.0:1785393943.247474:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+7:2357:x1872120807273344:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:2.0:1785393943.247514:0:5825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629979 00000020:00010000:2.0:1785393943.247520:0:5825:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93abc2041800: total 0 00000100:00080000:2.0:1785393943.247524:0:5825:0:(import.c:65:import_set_state_nolock()) ffff93abc2042800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1785393943.247615:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd05ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f46be8a-a627-4a5a-a70c-b3de933a0da6+3:2357:x1872120807273344:12345-192.168.203.12@tcp:251:umount.0 Request processed in 142us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393943.247621:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 331 00000020:00010000:1.0:1785393943.247735:0:5819:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93abc2041800: total 0 00010000:00010000:1.0:1785393943.247777:0:5819:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93abc2041800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1785393943.247803:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42200/0xcc9b96d8b3629a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd527 expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393943.247815:0:5819:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93abc2041800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1785393943.247822:0:5819:0:(genops.c:906:class_export_put()) final put ffff93abc2041800/2f46be8a-a627-4a5a-a70c-b3de933a0da6 00010000:00010000:1.0:1785393943.247837:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393943.247839:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393943.247841:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1785393943.248277:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc2041800/2f46be8a-a627-4a5a-a70c-b3de933a0da6 for MGS 00000020:00000080:2.0:1785393943.248309:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc2042800 for MGS 00010000:00010000:0.0:1785393943.648753:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785393944.201425:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:1.0:1785393944.201444:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1785393944.201470:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000001:00080000:1.0:1785393944.201477:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1785393944.201481:0:5853:0:(genops.c:906:class_export_put()) final put ffff93abc125f800/21cecf35-5d73-4c59-b498-ba47bfa21eb7 00000001:00100000:1.0:1785393944.201497:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000001:00080000:1.0:1785393944.201503:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1785393944.201505:0:5853:0:(genops.c:906:class_export_put()) final put ffff93abc2044000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:1.0:1785393944.201520:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc125f800/21cecf35-5d73-4c59-b498-ba47bfa21eb7 for lustre-MDT0000 00000020:00000080:1.0:1785393944.201564:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93abc2044000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-MDT0000 00000020:00000080:1.0:1785393944.201608:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc125d000 for lustre-MDT0000 00000020:00000080:1.0:1785393944.201613:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93abc2046000 for lustre-MDT0000 00000001:00100000:1.0:1785393944.239014:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:1.0:1785393944.239023:0:6656:0:(genops.c:906:class_export_put()) final put ffff93acd80ef000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e 00000020:00000080:3.0:1785393944.239181:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff93acd80ef000/cdff80e6-0298-4ec3-bd74-9f3c38d2038e for lustre-OST0000 00000020:00000080:3.0:1785393944.239231:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acd80ed000 for lustre-OST0000 00010000:00010000:1.0:1785393944.674215:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393945.695673:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785393945.829151:0:12761:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1785393945.840073:0:12761:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1785393945.840116:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393945.840141:0:12761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393945.840148:0:12761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393945.840155:0:12761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393945.840182:0:12761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1785393945.840187:0:12761:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1785393945.840212:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785393945.840216:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1785393945.840221:0:12761:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1785393945.840243:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acf6ec2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1785393945.840971:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831378048:0@lo:39:umount.0 00000100:00100000:1.0:1785393945.841032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393945.841104:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378048 00000100:00100000:1.0:1785393945.841111:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378048 00000100:00100000:1.0:1785393945.841156:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1785393945.841165:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872120831378048:12345-0@lo:39:umount.0 00010000:00010000:3.0:1785393945.841182:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393945.841189:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1785393945.841189:0:5832:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629788 00010000:00010000:3.0:1785393945.841196:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152b200 already unused, calling callback (ffffffffc1d67c20) 00000100:00080000:1.0:1785393945.841196:0:5832:0:(import.c:65:import_set_state_nolock()) ffff93ad0034c000 : changing import state from FULL to CLOSED 10000000:00010000:3.0:1785393945.841200:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.841208:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393945.841215:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393945.841220:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785393945.841223:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1785393945.841225:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1785393945.841244:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1872120831378048:12345-0@lo:39:umount.0 Request processed in 81us (212us total) trans 0 rc 0/0 00010000:00010000:3.0:1785393945.841246:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.841251:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393945.841385:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.841394:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152b200/0xcc9b96d8b36299fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.841417:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.841419:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.841421:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393945.841468:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831378176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785393945.841949:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393945.842976:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378176 00000100:00100000:3.0:1785393945.842982:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378176 00000100:00100000:3.0:1785393945.843021:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785393945.843029:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc852a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3316:x1872120831378176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785393945.843051:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785393945.843066:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0a00/0xcc9b96d8b3629a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36299fe expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.843079:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785393945.843124:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc852a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3316:x1872120831378176:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1785393945.843131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785393945.843190:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831378176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393945.844920:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393945.844948:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ec2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1785393945.844962:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831378048:0@lo:39:umount.0 00000100:00080000:3.0:1785393945.845086:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1785393945.845089:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1785393945.845094:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1785393945.847563:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1785393945.847588:0:5832:0:(genops.c:906:class_export_put()) final put ffff93acc2fb0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1785393945.847619:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc2fb0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1785393945.847677:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93ad0034c000 for lustre-MDT0000 00010000:00010000:3.0:1785393945.848371:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848385:0:12761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848392:0:12761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848409:0:12761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848430:0:12761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785393945.848436:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848443:0:12761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848450:0:12761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848456:0:12761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848468:0:12761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785393945.848478:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785393945.848483:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.848489:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393945.848493:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848525:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393945.848530:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848537:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031000 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785393945.848540:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848549:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785393945.848556:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393945.848561:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1785393945.848564:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1785393945.848566:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1785393945.848607:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848614:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785393945.848636:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848643:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc0031000/0xcc9b96d8b3629933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b362993a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.848657:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393945.848658:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393945.848660:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393945.849009:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393945.849023:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831378304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.849085:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785393945.849152:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393945.849159:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393945.849170:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785393945.849172:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1785393945.849184:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849189:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393945.849195:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849201:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d0600/0xcc9b96d8b3629a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629a13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849209:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.849210:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.849212:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.849221:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849228:0:12761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849233:0:12761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849238:0:12761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849247:0:12761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785393945.849251:0:12761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849262:0:12761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849267:0:12761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849273:0:12761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849281:0:12761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1785393945.849283:0:12761:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1785393945.849286:0:12761:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1785393945.849308:0:12761:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1785393945.849312:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1785393945.849316:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785393945.849322:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1785393945.849326:0:12761:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93acf769e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785393945.849331:0:12761:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93acffb35800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785393945.849336:0:12761:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff93ad008e0000) has exports, disconnecting them 00000020:00080000:3.0:1785393945.849340:0:12761:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93acf769e000), last request at 1785393942 00000020:00000080:3.0:1785393945.849346:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36298fb 00000100:00080000:3.0:1785393945.849361:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acf769f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1785393945.849391:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785393945.849395:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849401:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace0044200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393945.849404:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849416:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393945.849422:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393945.849426:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1785393945.849428:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1785393945.849430:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1785393945.849445:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849450:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393945.849463:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849469:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace0044200/0xcc9b96d8b3629c35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b3629c3c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849478:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393945.849481:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849486:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc29cc400 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393945.849489:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849495:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393945.849524:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393945.849528:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1785393945.849530:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1785393945.849532:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1785393945.849544:0:7522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849550:0:7522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785393945.849556:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849561:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc29cc400/0xcc9b96d8b36296e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36296ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393945.849587:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.849589:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393945.849591:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393945.849599:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831378688:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1785393945.849635:0:12761:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93acf769e000): rc 0 00000020:00000080:3.0:1785393945.849637:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acf769e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1785393945.849645:0:12761:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93acffb35800), last request at 1785393942 00000020:00000080:3.0:1785393945.849649:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629830 00000100:00080000:3.0:1785393945.849654:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acffb35000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1785393945.849664:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1785393945.849671:0:12761:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93acffb35800): rc 0 00000020:00000080:3.0:1785393945.849673:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acffb35800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1785393945.849686:0:12761:0:(mdd_device.c:2303:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa33d016d3ae0 00000100:00080000:3.0:1785393945.849703:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1785393945.849706:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1785393945.849717:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1785393945.849783:0:12761:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1785393945.849807:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acc88ff800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1785393945.849817:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1785393945.849819:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1785393945.849827:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1785393945.849893:0:12761:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1785393945.849902:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acc830f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1785393945.849929:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff93ad008e0000) has no exports 00000100:00100000:0.0:1785393945.850027:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831378432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.850059:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785393945.852285:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393945.852364:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831378816:0@lo:9:umount.0 00000100:00100000:2.0:1785393945.852409:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785393945.852433:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831378944:0@lo:9:umount.0 00000100:00100000:2.0:1785393945.852459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785393945.853678:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378816 00000100:00100000:3.0:1785393945.853685:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378816 00000100:00100000:3.0:1785393945.853723:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378944 00000100:00100000:3.0:1785393945.853726:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378944 00000100:00100000:3.0:1785393945.853743:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1785393945.853751:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1872120831378816:12345-0@lo:9:umount.0 00000020:00000080:3.0:1785393945.853772:0:6630:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362987d 00000100:00080000:3.0:1785393945.853778:0:6630:0:(import.c:65:import_set_state_nolock()) ffff93acf724a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785393945.854621:0:6630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1785393945.854941:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785393945.854945:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785393945.854957:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1785393945.854965:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd7e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1872120831378944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1785393945.854978:0:6632:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629964 00000100:00080000:2.0:1785393945.854983:0:6632:0:(import.c:65:import_set_state_nolock()) ffff93acf7249800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785393945.855003:0:6632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1785393945.855241:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd7e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3314:x1872120831378944:12345-0@lo:9:umount.0 Request processed in 276us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1785393945.855247:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:2.0:1785393945.855265:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393945.855294:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc830f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1785393945.855300:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785393945.855301:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785393945.855305:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831378944:0@lo:9:umount.0 00000100:00100000:3.0:1785393945.855494:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3314:x1872120831378816:12345-0@lo:9:umount.0 Request processed in 1743us (3084us total) trans 0 rc 0/0 00000100:00080000:2.0:1785393945.855610:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc88ff800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1785393945.855619:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785393945.855621:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785393945.855623:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831378816:0@lo:9:umount.0 00000100:00100000:3.0:1785393945.855680:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1785393945.855810:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785393945.862689:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831378560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.862748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393945.869392:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378304 00000100:00100000:1.0:1785393945.869420:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378304 00000100:00100000:1.0:1785393945.869485:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378432 00000100:00100000:1.0:1785393945.869488:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378432 00000100:00100000:1.0:1785393945.869521:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785393945.869529:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+19:3318:x1872120831378304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785393945.869544:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393945.869559:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031c00/0xcc9b96d8b362993a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629933 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.869594:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393945.869655:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+18:3318:x1872120831378304:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (20569us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393945.869661:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785393945.869676:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785393945.869681:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+17:3318:x1872120831378432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785393945.869688:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785393945.869695:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b3629a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629a0c expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393945.869702:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785393945.869719:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3318:x1872120831378432:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (19659us total) trans 0 rc 0/0 00000100:00100000:1.0:1785393945.869724:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1785393945.869739:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785393945.869748:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf769e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1785393945.869783:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acffb35800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1785393945.869813:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf769f800 for lustre-MDT0000 00000020:00000080:1.0:1785393945.869817:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acffb35000 for lustre-MDT0000 00000100:00100000:0.0:1785393945.870165:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378560 00000100:00100000:0.0:1785393945.870169:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378560 00000100:00100000:0.0:1785393945.870193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785393945.870198:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+16:3315:x1872120831378560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785393945.870205:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393945.870213:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42e00/0xcc9b96d8b3629c3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629c35 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393945.870223:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393945.870246:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3315:x1872120831378560:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (7498us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393945.870252:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785393945.870283:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831378432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.870291:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831378304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.870314:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785393945.870354:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831378560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785393945.870365:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831378688 00000100:00100000:0.0:1785393945.870368:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831378688 00000100:00100000:0.0:1785393945.870386:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785393945.870391:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+15:3316:x1872120831378688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785393945.870398:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785393945.870405:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42a00/0xcc9b96d8b36296ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36296e7 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393945.870417:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785393945.870440:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5+14:3316:x1872120831378688:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1785393945.870446:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785393945.870465:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3316:1872120831378688:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1785393945.890215:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff93ad008e0000) has no exports 00000020:00000080:0.0:1785393946.047328:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629742 00000020:00000080:0.0:1785393946.047344:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad00238000/lustre-QMT0000_UUID 00000020:01000000:0.0:1785393946.047412:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1785393946.051890:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785393946.051904:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1785393946.051909:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff93acc7ad4d40) has no exports 00000020:00000080:2.0:1785393946.052591:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362973b 00000020:00000080:2.0:1785393946.052599:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acf9545800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785393946.056605:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad00238000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1785393946.060049:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785393946.060062:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1785393946.060067:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acc31e7800/lustre-QMT0000_UUID 00000020:00000080:2.0:1785393946.060071:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc31e7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1785393946.060080:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1785393946.060596:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf9545800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1785393946.060772:0:12761:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acf9669600 - data ffff93accdfe4a20/ffff93ad00780400 00000020:01000000:2.0:1785393946.061069:0:12761:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acf78bf2a0 - data ffff93acddc58870/ffff93ad00920c00 00000001:00000004:3.0:1785393946.110810:0:12761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1785393946.291606:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1785393946.291613:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1785393946.291628:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1785393946.291641:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1785393946.294631:0:6673:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1785393946.294636:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1785393946.294647:0:6673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1785393946.295620:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1785393946.295624:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1785393946.295663:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1785393946.295665:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1785393946.306241:0:7784:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1785393946.306248:0:7784:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1785393946.306259:0:7784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1785393946.428923:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362970a 00000020:00000080:0.0:1785393946.428933:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acf6efd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785393946.429065:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6efd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785393946.429994:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362971f 00000020:00000080:0.0:1785393946.429999:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad0082c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1785393946.430016:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1785393946.430021:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393946.430028:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785393946.430032:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff93ad008e4d40) has no exports 00000020:00000080:1.0:1785393946.430063:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad0082c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1785393946.430183:0:12761:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1785393946.430195:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362995d 00000020:00000080:0.0:1785393946.430199:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acc8308000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1785393946.430208:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1785393946.430212:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393946.430214:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc8308000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1785393946.430218:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785393946.430220:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff93acf9663380) has no exports 00000020:00000080:0.0:1785393946.430225:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629956 00000020:00000080:0.0:1785393946.430228:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acc830a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785393946.430351:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc830a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1785393946.430554:0:12761:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1785393946.430557:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1785393946.430561:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1785393946.430566:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1785393946.430594:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1785393946.430631:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393946.430638:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785393946.430643:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629876 00000020:00000080:0.0:1785393946.430647:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acec19f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1785393946.430650:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1785393946.430654:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785393946.430655:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc830f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1785393946.430657:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1785393946.430659:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff93acce5d19c0) has no exports 00000020:00000080:3.0:1785393946.430660:0:8:0:(genops.c:906:class_export_put()) final put ffff93acc830d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785393946.430662:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc830d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1785393946.430662:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362986f 00000020:00000080:0.0:1785393946.430665:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acc88fb000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1785393946.430670:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785393946.430723:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acec19f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1785393946.430727:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc88fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1785393946.430967:0:12761:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1785393946.430970:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1785393946.430972:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1785393946.430975:0:12761:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1785393946.430976:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1785393946.431005:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393946.431010:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785393946.431028:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393946.431047:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785393946.431050:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acf6eff000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785393946.431053:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6eff000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1785393946.431056:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785393946.431061:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc88ff800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1785393946.431066:0:36:0:(genops.c:906:class_export_put()) final put ffff93acf6ec4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1785393946.431069:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6ec4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1785393946.431072:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785393946.439421:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629726 00000020:00000080:1.0:1785393946.439432:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad00828000/lustre-MDD0000_UUID 00000020:01000000:1.0:1785393946.439455:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1785393946.439463:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393946.439472:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1785393946.439475:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff93ad008e3380) has no exports 00000020:00000080:1.0:1785393946.439498:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393946.439503:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1785393946.439507:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362972d 00000020:00000080:1.0:1785393946.439511:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad0082f000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1785393946.439520:0:12761:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ace0136800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1785393946.439523:0:12761:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ace0136800 3 00000020:01000004:1.0:1785393946.439526:0:12761:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ace0136800 from lustre-MDT0000 00000020:00000080:1.0:1785393946.439545:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393946.439549:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1785393946.439552:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acf6ef8800/lustre-MDT0000_UUID 00000020:00000080:1.0:1785393946.439554:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6ef8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1785393946.439564:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1785393946.439564:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad00828000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1785393946.439581:0:36:0:(genops.c:906:class_export_put()) final put ffff93acf6efb000/lustre-MDD0000_UUID 00000020:00000080:0.0:1785393946.439583:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6efb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1785393946.439587:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1785393946.439686:0:12761:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1785393946.439690:0:12761:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1785393946.439701:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1785393946.439703:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393946.439706:0:12761:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1785393946.439711:0:12761:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff93acc7a8a800 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1785393946.439716:0:12761:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff93acc85a19c0) has exports, disconnecting them 00000020:00080000:1.0:1785393946.439720:0:12761:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93acc7a8a800), last request at 1785393644 00000020:00000080:1.0:1785393946.439732:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36296cb 00000020:00010000:1.0:1785393946.439736:0:12761:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93acc7a8a800: total 2 00000100:00080000:1.0:1785393946.439739:0:12761:0:(import.c:65:import_set_state_nolock()) ffff93acc7a89800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1785393946.439759:0:12761:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93acc7a8a800): rc 0 00000020:00080000:1.0:1785393946.439763:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff93acc85a19c0) has no exports 00000020:00000080:0.0:1785393946.439771:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad0082f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1785393946.439813:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93acec0ac000:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1785393946.439862:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93acec0ad000:5826] 2 exiting: rc = 0 00000020:00010000:3.0:1785393946.439910:0:5820:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93acc7a8a800: total 0 00010000:00010000:3.0:1785393946.439941:0:5820:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93acc7a8a800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1785393946.439968:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152a000/0xcc9b96d8b3629a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629a1a expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.439984:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d42000/0xcc9b96d8b3629c20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629c19 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.439994:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc0031200/0xcc9b96d8b36297e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36297dc expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440008:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43800/0xcc9b96d8b3629c2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b3629c27 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440020:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152a200/0xcc9b96d8b36299cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36299c6 expref: 5 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440053:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc152ba00/0xcc9b96d8b36299db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36299d4 expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440064:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace0044800/0xcc9b96d8b36299e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36299e2 expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440074:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ace2d43200/0xcc9b96d8b36299f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcc9b96d8b36299f0 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393946.440084:0:5820:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93acc7a8a800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1785393946.440097:0:5820:0:(genops.c:906:class_export_put()) final put ffff93acc7a8a800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 00010000:00010000:3.0:1785393946.440115:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393946.440118:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393946.440119:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393946.440397:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93acec0ade00:5825] 1 exiting: rc = 0 00000020:00000080:0.0:1785393946.440560:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc7a8a800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 for MGS 00000020:00000080:0.0:1785393946.440598:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc7a89800 for MGS 00000100:00100000:1.0:1785393946.440938:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440945:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440952:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440957:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440963:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440967:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440973:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440978:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440983:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440989:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.440996:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441002:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441007:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441012:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441018:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441023:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441029:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441034:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441050:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441054:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441060:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441073:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441078:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441083:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441088:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441093:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441099:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441104:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441110:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441116:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441121:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441127:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441131:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441137:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441145:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441151:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441156:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441161:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441167:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441172:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441177:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441182:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441187:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441192:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441198:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441203:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441208:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441213:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441218:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441223:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441228:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441234:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441239:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441244:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441249:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441254:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441266:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441271:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441276:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441282:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441287:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441292:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441307:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.441313:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1785393946.441645:0:12761:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785393946.441648:0:12761:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1785393946.445725:0:12761:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acf9669660 - data ffff93acddc36e58/ffff93ad00783c00 00000020:01000000:1.0:1785393946.445846:0:12761:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acc73e2f00 - data ffff93accdd5c5e8/ffff93acc7af3000 00000020:00000080:1.0:1785393946.446293:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36296af 00000020:00000080:1.0:1785393946.446935:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acce59e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1785393946.446955:0:12761:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ace0136800 from MGS, refs=2 00000020:01000004:1.0:1785393946.446959:0:12761:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ace0136800 2 00000020:01000004:1.0:1785393946.446962:0:12761:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ace0136800 from MGS 00000020:00000080:1.0:1785393946.446982:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393946.446987:0:12761:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1785393946.446990:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acce59d000/MGS 00000020:00000080:1.0:1785393946.446993:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93acce59d000/MGS for MGS 00000020:01000000:1.0:1785393946.446998:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1785393946.447053:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1785393946.447056:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393946.447061:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1785393946.447067:0:12761:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93ad0023d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1785393946.447073:0:12761:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff93ad008e19c0) has exports, disconnecting them 00000020:00080000:1.0:1785393946.447077:0:12761:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93ad0023d800), last request at 1785393645 00000020:00000080:1.0:1785393946.447081:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362977a 00000020:00080000:1.0:1785393946.447091:0:12761:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ad0023d800): rc 0 00000020:00000080:1.0:1785393946.447094:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad0023d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1785393946.447520:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acce59e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785393946.447528:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad0023d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1785393946.455316:0:12761:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1785393946.455325:0:12761:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785393946.455329:0:12761:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1785393946.455335:0:12761:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1785393946.455441:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf6ec2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1785393946.455482:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393946.455491:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1785393946.455496:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ad0082b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1785393946.455499:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93ad0082b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1785393946.455510:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1785393946.455563:0:12761:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ace0136800 1 00000020:00000080:0.0:1785393946.455593:0:12761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36296a1 00000020:00000080:0.0:1785393946.455599:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acce59e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1785393946.455608:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1785393946.455612:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393946.455616:0:12761:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1785393946.455620:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff93acc953cd40) has no exports 00000020:00000080:3.0:1785393946.456063:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acce59e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785393946.555189:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785393946.555203:0:12761:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1785393946.555208:0:12761:0:(genops.c:906:class_export_put()) final put ffff93ace0134800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785393946.555213:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93ace0134800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1785393946.555222:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1785393946.555348:0:12761:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ace0133000 00000020:01000000:3.0:1785393946.555367:0:12761:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1785393946.555370:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785393946.555374:0:12761:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1785393946.555378:0:12761:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff93acc7ad19c0) has no exports 00000100:00100000:3.0:1785393946.555441:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93acc7ae6000:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1785393946.555543:0:10972:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93acffa8ca00:10972] 3 exiting: rc = 0 00000100:00100000:0.0:1785393946.557354:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93acd05d1c00:5833] 2 exiting: rc = 0 00000100:00100000:1.0:1785393946.561773:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93acc6d16400:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.562715:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562723:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562729:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562735:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562741:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562747:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562752:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562757:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562762:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562767:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562772:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562778:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562783:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562789:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562795:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562800:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562805:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562809:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562815:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562819:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562835:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562842:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562847:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562852:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562857:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562874:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562880:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562886:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562891:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562896:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562901:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562906:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562912:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562917:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562930:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562936:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562941:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562946:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562951:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562957:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562963:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562968:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562973:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562979:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562984:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562989:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562993:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.562999:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563004:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563009:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563014:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563019:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563025:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563030:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563045:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563052:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563058:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563064:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563070:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563076:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563082:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563088:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563094:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.563106:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393946.566103:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93acc9aa1400:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1785393946.569019:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93acc5155000:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.569693:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569701:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569707:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569713:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569719:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569734:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569739:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569745:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569751:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569757:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569763:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569768:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569774:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.569779:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570025:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570032:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570046:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570052:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570057:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570062:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570068:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570072:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570077:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570082:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570087:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570091:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570096:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570100:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570105:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570110:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570115:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570120:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570125:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570130:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570135:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570140:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570145:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570150:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570155:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570159:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570171:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570176:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570181:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570186:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570191:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570196:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570201:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570205:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570210:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570215:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570220:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570225:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570230:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570235:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570239:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570244:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570249:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570254:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570259:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570264:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570268:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570272:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570277:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570281:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.570654:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93acc5163600:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1785393946.577748:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93acc5163800:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1785393946.687172:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687182:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687188:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687194:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687200:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687206:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687212:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687233:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687238:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687243:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687248:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687253:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687259:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687264:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687270:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687276:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687282:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687287:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687293:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687310:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687317:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687323:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687329:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687334:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687340:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687346:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687350:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687355:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687360:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687365:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687370:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687387:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687393:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687397:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687415:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687420:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687424:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687430:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687435:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687440:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687444:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687449:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687454:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687470:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687475:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687480:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687485:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687491:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687554:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687559:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687567:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687588:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687593:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687598:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687603:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687622:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687629:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687634:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687640:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687645:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687650:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687655:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687660:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393946.687671:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393946.710455:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93acc851b400:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1785393946.710748:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93acc85e3400:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.710811:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710818:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710823:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710828:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710834:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710840:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710845:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710850:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.710855:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711019:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711026:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711031:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711044:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711048:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711053:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711057:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711061:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711065:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711069:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711073:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711077:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711081:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711085:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711089:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711093:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711097:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711102:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711106:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711111:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711116:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711121:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711126:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711130:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711136:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711141:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711145:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711149:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711154:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711159:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711164:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711169:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711174:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711179:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711184:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711197:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711202:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711207:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711212:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711217:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711221:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711226:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711230:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711235:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711240:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711245:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711250:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711255:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711259:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711264:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711269:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711274:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711278:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711283:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711290:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711632:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93acc85e2200:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1785393946.711719:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93acc85e2400:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.711791:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711797:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711802:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711807:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711812:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711817:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711823:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711828:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711833:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711838:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711843:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711848:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711852:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711858:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.711998:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712003:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712007:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712012:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712016:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712021:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712026:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712030:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712044:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712051:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712055:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712060:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712065:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712070:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712075:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712080:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712085:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712089:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712094:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712098:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712105:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712110:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712115:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712119:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712124:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712130:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712134:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712139:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712144:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712148:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712153:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712157:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712161:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712166:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712170:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712183:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712188:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712194:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712199:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712204:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712209:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712215:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712220:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712224:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712229:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712234:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712239:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712243:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712248:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.712252:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393946.716333:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93acc8266000:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.717190:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93acc85e3600:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1785393946.717252:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717259:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717264:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717269:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717273:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717278:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717283:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717288:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717293:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717297:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717302:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717307:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717311:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717316:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717321:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717326:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717331:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717336:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717341:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717357:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717362:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717367:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717372:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717376:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717382:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717386:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717391:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717396:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717401:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717406:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717411:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717416:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717421:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717425:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717430:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717435:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717439:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717444:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717449:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717454:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717458:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717463:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717468:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717473:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717477:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717482:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717487:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717491:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717497:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717502:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717507:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717512:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717516:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717521:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717532:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717537:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717542:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717547:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717551:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717556:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717561:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717566:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717596:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.717601:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393946.721391:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93acc85e2a00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1785393946.721675:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93acd0425a00:5846] 2 exiting: rc = 0 00000100:00100000:2.0:1785393946.722790:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93acc85e3a00:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1785393946.724437:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724444:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724449:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724453:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724458:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724462:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724467:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724471:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724476:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724482:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724486:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724491:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724496:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724501:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724507:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724512:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724526:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724531:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724536:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724541:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724545:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724550:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724554:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724560:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724619:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724625:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724629:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724634:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724638:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724642:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724647:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724651:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724655:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724660:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724664:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724668:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724672:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724677:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724681:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724686:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724703:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724708:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724713:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724717:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724722:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724726:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724731:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724736:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724741:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724745:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724749:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724754:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724758:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724762:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724767:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724771:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724775:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.724780:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727101:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727122:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727127:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727133:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727138:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393946.727144:0:12761:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1785393946.763864:0:12761:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785393946.763877:0:12761:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1785393946.763882:0:12761:0:(genops.c:906:class_export_put()) final put ffff93acc31e4800/MDS_uuid 00000020:00000080:3.0:1785393946.763886:0:12761:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc31e4800/MDS_uuid for MDS 00000020:01000000:3.0:1785393946.763894:0:12761:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1785393946.764027:0:12761:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1785393947.175897:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831379200:0@lo:400:kworker.0 00000400:00000100:0.0:1785393947.175958:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831379200 offset 0 length 224: 4 00000100:00100000:0.0:1785393947.176063:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785393947.176070:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831379072:0@lo:400:kworker.0 00000400:00000100:0.0:1785393947.176089:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872120831379072 offset 0 length 224: 4 00000100:00100000:0.0:1785393947.176114:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831379328:0@lo:400:kworker.0 00000400:00000100:0.0:1785393947.176131:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831379328 offset 0 length 224: 4 00010000:00010000:3.0:1785393947.187070:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393948.191732:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393949.224053:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785393949.346349:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785393949.346357:0:6656:0:(genops.c:906:class_export_put()) final put ffff93acf724e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1785393949.346420:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf724e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1785393949.346461:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf724a000 for lustre-OST0000 00010000:00010000:2.0:1785393950.251606:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785393950.316959:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785393950.316966:0:7533:0:(genops.c:906:class_export_put()) final put ffff93acf724d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785393950.317022:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf724d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1785393950.317060:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf7249800 for lustre-OST0001 00000020:01000004:1.0:1785393950.853284:0:12914:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1785393950.897240:0:12914:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1785393950.897282:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393950.897297:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393950.897305:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393950.897313:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393950.897332:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1785393950.897337:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1785393950.897368:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1785393950.897378:0:12914:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9633100 x1872120831379200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393950.897405:0:12914:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1785393950.897409:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1785393950.897430:0:12914:0:(import.c:65:import_set_state_nolock()) ffff93acf724c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1785393950.897557:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831379456:0@lo:39:umount.0 00000400:00000100:0.0:1785393950.897628:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831379456 offset 0 length 224: 4 00010000:00010000:1.0:1785393950.899065:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393950.899073:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393950.899092:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152aa00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785393950.899096:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393950.899105:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785393950.899113:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393950.899119:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785393950.899121:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1785393950.899124:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1785393950.899150:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393950.899157:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785393950.899180:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393950.899188:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152aa00/0xcc9b96d8b36299e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcc9b96d8b36299e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393950.899199:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393950.899201:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393950.899203:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393950.899362:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831379200:0@lo:400:kworker.0 00000100:00100000:3.0:1785393950.899608:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785393950.899620:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831379584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785393950.899664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785393950.900455:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831379584 00000100:00100000:1.0:1785393950.900462:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831379584 00000100:00100000:1.0:1785393950.900499:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785393950.900506:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1872120831379584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1785393950.900519:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785393950 with bad export cookie 14743543662594135755 00000100:00100000:2.0:1785393950.918914:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1872120831379584:12345-0@lo:103:ldlm_bl.0 Request processed in 18400us (19242us total) trans 0 rc -107/-107 00000100:00100000:2.0:1785393950.918926:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1785393950.919250:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1785393950.919255:0:3315:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1785393950.919259:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1785393950.933805:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1785393950.933811:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1785393950.933821:0:3315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9631500 x1872120831379072/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1785393963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393950.933919:0:3315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9631f80 x1872120831379584/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1785393966 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1785393950.933929:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1785393950.933948:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1785393950.933949:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1785393950.933953:0:3315:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785393950.933958:0:3315:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 176 00000100:00080000:0.0:1785393950.934039:0:3315:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff93acc7a8b800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1785393950.934067:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad003c9500 x1872120831379712/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785393950.934127:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831379712:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1785393950.934173:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872120831379712 offset 0 length 520: 4 00000100:00100000:2.0:1785393950.934270:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3318:1872120831379072:0@lo:400:kworker.0 00000100:00100000:0.0:1785393950.934325:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3315:1872120831379584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785393951.264101:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393952.287763:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785393952.288120:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785393952.288129:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1785393952.288227:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785393952.288248:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831379840:0@lo:400:kworker.0 00000400:00000100:2.0:1785393952.288298:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831379840 offset 0 length 224: 4 00010000:00010000:1.0:1785393953.315978:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393954.338211:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785393955.295798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1785393955.295819:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1785393955.296059:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785393955.296085:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831379968:0@lo:400:kworker.0 00000400:00000100:3.0:1785393955.296156:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831379968 offset 0 length 224: 4 00010000:00010000:2.0:1785393955.361325:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393956.387197:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393957.408016:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393958.431875:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393959.456492:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785393960.481474:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785393950/real 1785393950] req@ffff93ad003c9500 x1872120831379712/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785393960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393960.481525:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ad003c9500 x1872120831379712/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785393960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393960.481563:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785393950/real 1785393950] req@ffff93acf7d73100 x1872120831379456/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785393960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785393960.481603:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93acf7d73100 x1872120831379456/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785393960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785393960.481620:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785393960.481629:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1785393960.481632:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831379712:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1785393960.481640:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf724c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1785393960.481651:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831379456:0@lo:39:umount.0 00010000:00010000:2.0:1785393960.481686:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785393960.481893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1785393960.481899:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1785393960.481902:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785393960.481908:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1785393960.481914:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785393960.481923:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff93acc7a8b800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785393960.481972:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9631180 x1872120831380096/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785393960.482033:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831380096:0@lo:250:kworker.0 00000400:00000100:1.0:1785393960.482107:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872120831380096 offset 0 length 520: 4 00000100:00100000:1.0:1785393960.483245:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785393960.483257:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831380224:0@lo:400:kworker.0 00000400:00000100:1.0:1785393960.483283:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831380224 offset 0 length 224: 4 00000100:00080000:1.0:1785393960.483343:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785393960.483347:0:12914:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1785393960.483353:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1785393960.488616:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488638:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488646:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488674:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488702:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785393960.488710:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488718:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488724:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488731:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393960.488747:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1785393960.488751:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1785393960.488779:0:12914:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1785393960.488784:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1785393960.488789:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393960.488795:0:12914:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785393960.488799:0:12914:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff93acc95399c0) has no exports 00000020:00080000:1.0:1785393960.488828:0:12914:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff93acc95399c0) has no exports 00010000:00010000:2.0:1785393960.493022:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785393960.493040:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493067:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc152a800 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393960.493072:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493085:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393960.493093:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393960.493100:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785393960.493103:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1785393960.493185:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1785393960.493208:0:7522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:2.0:1785393960.493212:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493221:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152a800/0xcc9b96d8b36299f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493238:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785393960.493242:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493248:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0c00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785393960.493251:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493259:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785393960.493264:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785393960.493270:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1785393960.493272:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1785393960.493274:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1785393960.493278:0:7522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:2.0:1785393960.493281:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493288:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acff9f0c00/0xcc9b96d8b3629c27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b3629c2e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785393960.493306:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393960.493308:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393960.493310:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393960.493345:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785393960.499067:0:12914:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acffad5c60 - data ffff93accddefca8/ffff93abc1b6a800 00000020:01000000:1.0:1785393960.499631:0:12914:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acc84f0d80 - data ffff93acddc71360/ffff93abc11a0800 00100000:10000000:1.0:1785393960.561427:0:12914:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1785393960.626272:0:12914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36297ff 00000020:00000080:2.0:1785393960.626284:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acf724e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1785393960.626307:0:12914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acc825e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1785393960.626311:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc825e800 2 00000020:01000004:2.0:1785393960.626315:0:12914:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93acc825e800 from lustre-OST0000 00000020:00000080:2.0:1785393960.626347:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785393960.626359:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1785393960.626362:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acfb829000/lustre-OST0000_UUID 00000020:00000080:2.0:1785393960.626365:0:12914:0:(genops.c:865:class_export_destroy()) destroying export ffff93acfb829000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1785393960.626373:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1785393960.626420:0:12914:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1785393960.626425:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1785393960.626429:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785393960.626434:0:12914:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785393960.626441:0:12914:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93acffb30800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785393960.626448:0:12914:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff93acc7ad3380) has exports, disconnecting them 00000020:00080000:2.0:1785393960.626453:0:12914:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93acffb30800), last request at 1785393670 00000020:00000080:2.0:1785393960.626457:0:12914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629829 00000020:00080000:2.0:1785393960.626466:0:12914:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93acffb30800): rc 0 00000020:00000080:2.0:1785393960.626472:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acffb30800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1785393960.627320:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf724e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1785393960.627330:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acffb30800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1785393960.665661:0:12914:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1785393960.665673:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785393960.665679:0:12914:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1785393960.665688:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1785393960.665729:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf724c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1785393960.665940:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393960.665963:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1785393960.665969:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acf724f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1785393960.665974:0:12914:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf724f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1785393960.665989:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1785393960.666280:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc825e800 1 00000020:00000080:0.0:1785393960.666288:0:12914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36297b9 00000020:00000080:0.0:1785393960.666295:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acc78c3800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1785393960.666304:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1785393960.666313:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc78c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1785393960.666327:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393960.666343:0:12914:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785393960.666348:0:12914:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff93acc7ad0000) has no exports 00000020:00000080:0.0:1785393960.721965:0:12914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393960.721985:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1785393960.721992:0:12914:0:(genops.c:906:class_export_put()) final put ffff93acc8259000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1785393960.721998:0:12914:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc8259000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1785393960.722010:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1785393960.722300:0:12914:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93acc8258000 00000020:02000400:0.0:1785393960.722363:0:12914:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1785393961.514913:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393962.553194:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785393963.551768:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1785393963.566895:0:3315:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785393947/real 1785393947] req@ffff93acf9632d80 x1872120831379328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785393963 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785393963.629151:0:3315:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93acf9632d80 x1872120831379328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785393963 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785393963.629167:0:3315:0:(import.c:65:import_set_state_nolock()) ffff93acf724f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1785393963.629172:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1785393963.662719:0:3315:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1785393963.664977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785393963.664983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1785393963.664987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785393963.664991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1785393963.664996:0:36:0:(import.c:65:import_set_state_nolock()) ffff93acf724f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785393963.665006:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 226 00000100:00080000:0.0:1785393963.665017:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93acf724f000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1785393963.665036:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831379328:0@lo:400:kworker.0 00000100:00100000:0.0:1785393963.665071:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad003cad80 x1872120831380352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785393963.665167:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831380352:0@lo:38:kworker.0 00000400:00000100:2.0:1785393963.665238:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872120831380352 offset 0 length 520: 4 00010000:00010000:2.0:1785393964.576730:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1785393965.465531:0:13066:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1785393965.485188:0:13066:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1785393965.485248:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.485263:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.485270:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.485277:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.485293:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1785393965.485298:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1785393965.485319:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785393965.485329:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ad003cb100 x1872120831379840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393968 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393965.485347:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf7d5a680 x1872120831379968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393965.485358:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9631f80 x1872120831380224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393976 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393965.485371:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ad003cad80 x1872120831380352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785393973 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785393965.485381:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1785393965.485780:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831379840:0@lo:400:kworker.0 00000100:00080000:2.0:1785393965.485938:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf724f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785393965.485943:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1785393965.485947:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831380352:0@lo:38:kworker.0 00010000:00010000:3.0:1785393965.486111:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785393965.486118:0:7522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393965.486126:0:7522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:3.0:1785393965.486130:0:7522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393965.486139:0:7522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785393965.486146:0:7522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785393965.486151:0:7522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785393965.486154:0:7522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1785393965.486156:0:7522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1785393965.486168:0:7522:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:3.0:1785393965.486172:0:7522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393965.486179:0:7522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace2d43600/0xcc9b96d8b36299c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785393965.486188:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393965.486190:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393965.486192:0:7522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785393965.486216:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831379968:0@lo:400:kworker.0 00000100:00080000:0.0:1785393965.492937:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1785393965.492949:0:13066:0:(import.c:65:import_set_state_nolock()) ffff93acf724f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1785393965.492959:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785393965.492970:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9631f80 x1872120831380224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785393976 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785393965.492983:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785393965.492988:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1785393965.493687:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831380224:0@lo:400:kworker.0 00010000:00010000:0.0:1785393965.496505:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496522:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496529:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496536:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496559:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785393965.496565:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496590:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496596:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496602:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.496615:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1785393965.496619:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1785393965.496639:0:13066:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1785393965.496643:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1785393965.496647:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393965.496652:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785393965.496666:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff93acc85a4d40) has no exports 00000020:00080000:0.0:1785393965.496687:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff93acc85a4d40) has no exports 00010000:00010000:1.0:1785393965.497090:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785393965.497097:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497115:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43c00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785393965.497119:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497128:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785393965.497135:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393965.497141:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785393965.497144:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1785393965.497146:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1785393965.497158:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:1.0:1785393965.497161:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497168:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ace2d43c00/0xcc9b96d8b36299d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36299db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497180:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785393965.497183:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497188:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785393965.497191:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497198:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785393965.497208:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785393965.497214:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785393965.497216:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785393965.497217:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1785393965.497221:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:1.0:1785393965.497224:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497230:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d0c00/0xcc9b96d8b3629c19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b3629c20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785393965.497242:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393965.497243:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785393965.497245:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785393965.497359:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785393965.503015:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acffad5720 - data ffff93accdfbba20/ffff93abc1b6b800 00000020:01000000:1.0:1785393965.503157:0:13066:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93acf9755c60 - data ffff93accdff06c0/ffff93acffdd9000 00100000:10000000:3.0:1785393965.519150:0:13066:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1785393965.552515:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36298ca 00000020:00000080:2.0:1785393965.552523:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acf769b000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1785393965.552533:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acc8926000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1785393965.552536:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc8926000 2 00000020:01000004:2.0:1785393965.552539:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93acc8926000 from lustre-OST0001 00000020:00000080:2.0:1785393965.552559:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785393965.552587:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1785393965.552589:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acf769c800/lustre-OST0001_UUID 00000020:00000080:2.0:1785393965.552592:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf769c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1785393965.552598:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1785393965.552668:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf769b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1785393965.559300:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5->MGS 00010000:00010000:0.0:1785393965.559323:0:13066:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785393965.559338:0:13066:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393965.559345:0:13066:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1785393965.559347:0:13066:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1785393965.559350:0:13066:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1785393965.559372:0:13066:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:0.0:1785393965.559376:0:13066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc152a400/0xcc9b96d8b36297dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b36297e3 expref: -99 pid: 6627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785393965.559395:0:13066:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785393965.559402:0:13066:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785393965.559406:0:13066:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1785393965.559408:0:13066:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1785393965.559410:0:13066:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1785393965.559417:0:13066:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93acc7a8b800 00010000:00010000:0.0:1785393965.559419:0:13066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d1c00/0xcc9b96d8b3629a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcc9b96d8b3629a21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785393965.559432:0:13066:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1785393965.559443:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1785393965.559445:0:13066:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1785393965.559447:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1785393965.559450:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1785393965.559459:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93acf9631180 x1872120831380096/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1785393975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1785393965.559539:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1785393965.559541:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1785393965.559611:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5:3314:1872120831380096:0@lo:250:kworker.0 10000000:01000000:0.0:1785393965.560182:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1785393965.560192:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36296bd 00000020:00000080:0.0:1785393965.560198:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acc31e1800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 00000020:01000000:0.0:1785393965.560208:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:0.0:1785393965.560214:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393965.560220:0:13066:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1785393965.560225:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff93acc9538000) has no exports 00000020:00000080:2.0:1785393965.560272:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc31e1800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 for MGC192.168.203.112@tcp 10000000:01000000:1.0:1785393965.560319:0:5828:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1785393965.561196:0:13066:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:0.0:1785393965.561199:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1785393965.561202:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1785393965.561204:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1785393965.561206:0:13066:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1785393965.561250:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785393965.561255:0:13066:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid 3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5) 00000020:01000000:0.0:1785393965.561260:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1785393965.561262:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785393965.561266:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1785393965.561271:0:13066:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93acf7248000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785393965.561275:0:13066:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff93acce5d4d40) has exports, disconnecting them 00000020:00080000:0.0:1785393965.561279:0:13066:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93acf7248000), last request at 1785393694 00000020:00000080:0.0:1785393965.561283:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b36298f4 00000020:00080000:0.0:1785393965.561292:0:13066:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93acf7248000): rc 0 00000020:00000080:0.0:1785393965.561295:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acf7248000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1785393965.561741:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acc7a8b800 for MGC192.168.203.112@tcp 00000020:00000080:1.0:1785393965.561748:0:36:0:(genops.c:906:class_export_put()) final put ffff93acc9367800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 00000020:00000080:1.0:1785393965.561750:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc9367800/3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5 for MGC192.168.203.112@tcp 00000020:01000000:1.0:1785393965.561758:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (3cd625d8-be4d-4c8b-b5a6-d35a4b0f09a5) 00000020:00000080:1.0:1785393965.563595:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf7248000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1785393965.564667:0:13066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1785393965.564672:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785393965.564675:0:13066:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1785393965.564680:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1785393965.564851:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93acf724f000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1785393965.568260:0:7522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1785393965.569059:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1785393965.569967:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1785393965.570221:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93acc922be00:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1785393965.570315:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93acd057f000:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1785393965.578518:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.579533:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93acec0ae400:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1785393965.579662:0:6645:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93acffaff600:6645] 3 exiting: rc = 0 00000100:00100000:3.0:1785393965.580354:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93acec0af800:5818] 2 exiting: rc = 0 00000100:00100000:0.0:1785393965.580463:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93acec0ac600:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1785393965.580496:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580505:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580510:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580515:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580521:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580531:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580538:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580544:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580550:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580558:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580564:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580644:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580650:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580656:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580662:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580733:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580867:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580938:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580944:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580949:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580958:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580964:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580970:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580976:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580981:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.580986:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581010:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581016:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581021:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581027:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581032:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581039:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581044:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581049:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581065:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581070:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581076:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581081:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581085:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581091:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581096:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581249:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581254:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581259:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581264:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581372:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581379:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.581457:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582348:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582357:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582381:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582458:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582465:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582470:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582475:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582500:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582507:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.582512:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583364:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583371:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583376:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583380:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583389:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.583394:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1785393965.588876:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393965.588888:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1785393965.588894:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acf6efc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1785393965.588898:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff93acf6efc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1785393965.588907:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1785393965.588971:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc8926000 1 00000020:00000080:1.0:1785393965.588977:0:13066:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b3629899 00000020:00000080:1.0:1785393965.588983:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acc8309000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1785393965.588993:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1785393965.588998:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393965.589003:0:13066:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1785393965.589006:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff93acf72519c0) has no exports 00000020:00000080:3.0:1785393965.590171:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc8309000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1785393965.615354:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393965.615373:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1785393965.615379:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acc8922800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1785393965.615383:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc8922800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1785393965.615446:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1785393965.615632:0:13066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93acc8927000 00000020:01000000:1.0:1785393965.615653:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1785393965.615657:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785393965.615661:0:13066:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785393965.615664:0:13066:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff93acc953b380) has no exports 00000020:00000080:1.0:1785393965.615683:0:13066:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785393965.615688:0:13066:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1785393965.615691:0:13066:0:(genops.c:906:class_export_put()) final put ffff93acc78c1000/OSS_uuid 00000020:00000080:1.0:1785393965.615693:0:13066:0:(genops.c:865:class_export_destroy()) destroying export ffff93acc78c1000/OSS_uuid for OSS 00000020:01000000:1.0:1785393965.615697:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1785393965.616054:0:6630:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93acc8306600:6630] 0 exiting: rc = 1 00000100:00100000:0.0:1785393965.616148:0:6631:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93acd05d1200:6631] 1 exiting: rc = 0 00000100:00080000:2.0:1785393965.616249:0:5827:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1785393965.616626:0:6632:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93acd05d0000:6632] 2 exiting: rc = 0 00000100:00100000:1.0:1785393965.616672:0:8307:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93acd0480800:8307] 3 exiting: rc = 0 00000100:00100000:2.0:1785393965.616828:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616835:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616848:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616867:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616873:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616879:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616884:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616889:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616894:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616900:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616906:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616922:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616928:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616934:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616938:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616943:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616948:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616953:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616958:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616963:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616975:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616980:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616986:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616991:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.616997:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617002:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617008:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617013:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617018:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617024:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617029:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617034:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617039:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617044:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617049:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617054:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617059:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617064:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617078:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617083:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617088:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617095:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617111:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617117:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617122:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617126:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617131:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617136:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617142:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617147:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617152:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617158:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617162:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617168:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617173:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617178:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617183:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617189:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617194:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617199:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617205:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617210:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617215:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617220:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.617937:0:6634:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93acd05d1e00:6634] 1 exiting: rc = 0 00000100:00100000:2.0:1785393965.617993:0:8170:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93ad007a5c00:8170] 2 exiting: rc = 0 00000100:00100000:1.0:1785393965.618156:0:6633:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93acd05d0800:6633] 0 exiting: rc = 1 00000100:00100000:2.0:1785393965.618534:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.618542:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.618558:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.618563:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619094:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619169:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619174:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619192:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619197:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619203:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619210:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619214:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619219:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619224:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619229:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619233:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619238:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619242:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619248:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619253:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619258:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619262:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619268:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619274:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619278:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619283:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619287:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619292:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619297:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619302:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619307:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619312:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619318:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619322:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619328:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619333:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619337:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619342:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619347:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619351:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619356:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619360:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619374:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619379:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619383:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619388:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619402:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619408:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619413:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619418:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619425:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619430:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619435:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619439:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619443:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619448:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619452:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619457:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619461:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619466:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619470:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619475:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619479:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.619483:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.621136:0:6637:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93acc85ed000:6637] 2 exiting: rc = 0 00000100:00100000:0.0:1785393965.621465:0:6636:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93acc85ede00:6636] 1 exiting: rc = 0 00000100:00100000:2.0:1785393965.621895:0:6635:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93accb138c00:6635] 0 exiting: rc = 1 00000100:00100000:1.0:1785393965.623608:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623617:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623622:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623628:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623633:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623638:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623643:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623665:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.623675:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624249:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624259:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624265:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624270:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624275:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624292:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624298:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624303:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624308:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624314:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624319:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624324:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624330:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624335:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624340:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624345:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624352:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624357:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624363:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624367:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624384:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624390:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624395:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624401:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624406:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624412:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624417:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624422:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624428:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624449:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624457:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624462:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624468:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624481:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624486:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624492:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624497:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624503:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624509:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624513:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624519:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624523:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624529:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624534:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624539:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624544:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624551:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624556:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624561:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624567:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624607:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624613:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624619:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624625:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785393965.624631:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393965.630685:0:6638:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93acc85ecc00:6638] 0 exiting: rc = 1 00000100:00100000:0.0:1785393965.630685:0:6639:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93acda7af400:6639] 1 exiting: rc = 0 00000100:00100000:2.0:1785393965.638885:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638893:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638898:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638903:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638916:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638922:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638926:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638932:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638936:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638941:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638945:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638949:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638964:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638968:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638973:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638977:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638981:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638986:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638990:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638994:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.638998:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639002:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639006:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639011:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639015:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639019:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639765:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639779:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639783:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639788:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639792:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639796:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639803:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639808:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639812:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639816:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639821:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639825:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639829:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639834:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639838:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639843:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639847:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639851:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639855:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639859:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639866:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639877:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639881:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639893:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639898:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639903:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639907:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639919:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639924:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639929:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639933:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639938:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639942:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639946:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639951:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639955:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639959:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785393965.639969:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785393965.641601:0:6641:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93acf7af1800:6641] 1 exiting: rc = 0 00000100:00100000:3.0:1785393965.647273:0:6640:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93acf76de000:6640] 0 exiting: rc = 1 00000100:00100000:0.0:1785393965.648332:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648341:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648347:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648353:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648359:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648364:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648370:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648376:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648410:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648419:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648425:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648431:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648437:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648444:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648450:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648456:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648462:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648469:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648475:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648482:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648505:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648512:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648518:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648524:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648531:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648536:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648540:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648546:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.648551:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649168:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649177:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649183:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649202:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649209:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649214:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649220:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649226:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649231:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649237:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649243:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649249:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649255:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649261:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649267:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649286:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649293:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649298:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649303:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649309:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649314:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649320:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649325:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649331:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649337:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649343:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649348:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649366:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649373:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.649379:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.650492:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.650506:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.650512:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.650520:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785393965.650527:0:13066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1785393965.680731:0:13066:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1785393993.246090:0:13684:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1785394004.772675:0:14097:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785394004.772680:0:14097:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785394004.772804:0:14097:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93abc19f3000 00000020:01000004:3.0:1785394004.772818:0:14097:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1785394004.772826:0:14097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785394004.772838:0:14097:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93acf9663380) 00000020:00000080:3.0:1785394004.772850:0:14097:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785394004.820800:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785394004.827303:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1785394004.831377:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 353: rc = 0 00100000:10000000:2.0:1785394004.832781:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1785394004.832886:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 353: rc = 0 00100000:10000000:2.0:1785394004.832982:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 353: rc = 0 00100000:10000000:2.0:1785394004.833081:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:2.0:1785394004.833177:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:2.0:1785394004.833302:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 353: rc = 0 00100000:10000000:2.0:1785394004.834438:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 355: rc = 0 00100000:10000000:2.0:1785394004.838552:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 240: rc = 0 00100000:10000000:2.0:1785394004.838730:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 240: rc = 0 00100000:10000000:2.0:1785394004.839171:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1785394004.842757:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:2.0:1785394004.843101:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.845759:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:2.0:1785394004.846052:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.846308:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.848598:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1785394004.848872:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.849092:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.850767:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1785394004.851040:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1785394004.853749:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:2.0:1785394004.854177:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 377: rc = 0 00100000:10000000:2.0:1785394004.856866:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 377: rc = 0 00100000:10000000:2.0:1785394004.857145:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 377: rc = 0 00100000:10000000:2.0:1785394004.857373:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 377: rc = 0 00100000:10000000:2.0:1785394004.859434:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 377: rc = 0 00100000:10000000:2.0:1785394004.859907:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 377: rc = 0 00100000:10000000:2.0:1785394004.860157:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 377: rc = 0 00100000:10000000:2.0:1785394004.862901:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 377: rc = 0 00100000:10000000:2.0:1785394004.865387:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 377: rc = 0 00100000:10000000:2.0:1785394004.865787:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 377: rc = 0 00100000:10000000:2.0:1785394004.866031:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 377: rc = 0 00100000:10000000:2.0:1785394004.868405:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 377: rc = 0 00100000:10000000:2.0:1785394004.868929:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 377: rc = 0 00100000:10000000:2.0:1785394004.869172:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 377: rc = 0 00100000:10000000:2.0:1785394004.870904:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 377: rc = 0 00100000:10000000:2.0:1785394004.871147:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 377: rc = 0 00100000:10000000:2.0:1785394004.874600:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 377: rc = 0 00100000:10000000:2.0:1785394004.874856:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 377: rc = 0 00100000:10000000:2.0:1785394004.875100:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 377: rc = 0 00100000:10000000:2.0:1785394004.878426:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 377: rc = 0 00100000:10000000:2.0:1785394004.879810:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 377: rc = 0 00100000:10000000:2.0:1785394004.880055:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 377: rc = 0 00100000:10000000:2.0:1785394004.882108:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 377: rc = 0 00100000:10000000:2.0:1785394004.883153:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 377: rc = 0 00100000:10000000:3.0:1785394004.893866:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 377: rc = 0 00100000:10000000:3.0:1785394004.894133:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 377: rc = 0 00100000:10000000:3.0:1785394004.897684:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 377: rc = 0 00100000:10000000:3.0:1785394004.897944:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 377: rc = 0 00100000:10000000:3.0:1785394004.898164:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 377: rc = 0 00100000:10000000:3.0:1785394004.901861:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 377: rc = 0 00100000:10000000:3.0:1785394004.902119:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 377: rc = 0 00100000:10000000:3.0:1785394004.902355:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 377: rc = 0 00100000:10000000:3.0:1785394004.906904:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 520: rc = 0 00100000:10000000:3.0:1785394004.910042:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1785394004.910201:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 364: rc = 0 00100000:10000000:3.0:1785394004.910384:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1785394004.914835:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 364: rc = 0 00100000:10000000:3.0:1785394004.915078:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1785394004.915154:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 364: rc = 0 00100000:10000000:3.0:1785394004.918354:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1785394004.918644:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 241: rc = 0 00100000:10000000:3.0:1785394004.918860:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1785394004.918915:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 241: rc = 0 00100000:10000000:3.0:1785394004.919099:0:14097:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1785394004.919155:0:14097:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 241: rc = 0 00000020:00000080:2.0:1785394004.924783:0:14097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1785394004.924793:0:14097:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785394004.924803:0:14097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362a9c5 00000020:01000004:2.0:1785394004.924811:0:14097:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1785394004.924815:0:14097:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1785394004.924820:0:14097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93abc19f3000 from MGS 00000020:01000004:2.0:1785394004.924823:0:14097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1785394004.924834:0:14097:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93acf7254d40) 00000020:00000080:2.0:1785394004.924842:0:14097:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1785394004.924889:0:14097:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93abc19f3000 from MGS, refs=2 00080000:01000000:2.0:1785394004.924893:0:14097:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785394004.924897:0:14097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362a9d3 00000100:00100000:2.0:1785394004.924983:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1785394004.925086:0:14097:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1785394004.925091:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1785394004.931557:0:14097:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1785394004.931610:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1785394004.933009:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785394004.933160:0:14097:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1785394004.933164:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1785394004.933772:0:14097:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1785394004.933779:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1785394004.935743:0:14097:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1785394004.935751:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1785394004.938732:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394004.938736:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394004.938738:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394004.939728:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394004.939731:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394004.939733:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394004.942562:0:14097:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1785394004.945849:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1785394004.978144:0:14097:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1785394004.978160:0:14097:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785394004.978162:0:14097:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1785394004.990277:0:14106:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1785394004.990497:0:14097:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1785394004.990628:0:14097:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1785394004.991122:0:14097:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1785394004.991622:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785394004.991776:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1785394004.991782:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1785394004.994804:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1785394004.994814:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1785394004.996565:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1785394004.996596:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1785394005.002098:0:14097:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1785394005.002117:0:14097:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:3.0:1785394005.002119:0:14097:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1785394005.002141:0:14097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:3.0:1785394005.002152:0:14097:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff93acf96619c0) 00000020:00000080:3.0:1785394005.002164:0:14097:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1785394005.002228:0:14097:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acc886a000@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785394005.002424:0:14097:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:3.0:1785394005.002431:0:14097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:1.0:1785394005.002540:0:14111:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1785394005.005401:0:14112:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1785394005.005543:0:14097:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid daecb8d0-f73c-4aec-8915-f89616659996) 00000020:00000080:0.0:1785394005.005563:0:14097:0:(genops.c:1406:class_connect()) connect: client daecb8d0-f73c-4aec-8915-f89616659996, cookie 0xcc9b96d8b362a9e1 00000100:00080000:0.0:1785394005.005598:0:14097:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785394005.005604:0:14097:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff93acc886a000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1785394005.005635:0:14097:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ad003cb100 x1872120831380480/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785394005.005663:0:14097:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import daecb8d0-f73c-4aec-8915-f89616659996->MGS 00000020:01000004:0.0:1785394005.005678:0:14097:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1785394005.005682:0:14097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1785394005.005691:0:14097:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93acc85a0000) 00000020:00000080:0.0:1785394005.005700:0:14097:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1785394005.006283:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:daecb8d0-f73c-4aec-8915-f89616659996:3314:1872120831380480:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1785394005.006346:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.007624:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831380480 00000100:00100000:3.0:1785394005.007633:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831380480 00000100:00100000:3.0:1785394005.007676:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785394005.007684:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1872120831380480:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1785394005.007708:0:14108:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from daecb8d0-f73c-4aec-8915-f89616659996@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:3.0:1785394005.007729:0:14108:0:(genops.c:1406:class_connect()) connect: client daecb8d0-f73c-4aec-8915-f89616659996, cookie 0xcc9b96d8b362a9ef 00000100:00080000:3.0:1785394005.007828:0:14108:0:(import.c:65:import_set_state_nolock()) ffff93acc78c1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785394005.007891:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+5:3314:x1872120831380480:12345-0@lo:250:mount.lustre.0 Request processed in 206us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.007897:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785394005.007899:0:3314:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1785394005.007907:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:2.0:1785394005.007920:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1785394005.007923:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1785394005.007927:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acc886a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1785394005.007929:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1785394005.007937:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1785394005.007942:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:daecb8d0-f73c-4aec-8915-f89616659996:3314:1872120831380480:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1785394005.041842:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.042024:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1785394005.042032:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1785394005.047275:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1785394005.047291:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1785394005.047778:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1785394005.047785:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1785394005.048433:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785394005.048708:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1785394005.048712:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1785394005.058759:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1785394005.058771:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1785394005.190763:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.190941:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1785394005.190947:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1785394005.206674:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1785394005.206692:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1785394005.215743:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.215889:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785394005.215893:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1785394005.216767:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785394005.216773:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1785394005.217167:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.217268:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785394005.217273:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1785394005.221499:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1785394005.221623:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1785394005.222986:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.223121:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785394005.223125:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1785394005.234691:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785394005.234878:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1785394005.324473:0:14097:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394005.324704:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1785394005.324711:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1785394005.330550:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1785394005.330562:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1785394005.337797:0:14097:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1785394005.337823:0:14097:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1785394005.340152:0:14097:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1785394005.340174:0:14097:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1785394005.340179:0:14097:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1785394005.340293:0:14097:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1785394005.340325:0:14097:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1785394005.340330:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1785394005.340335:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785394005.340336:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785394005.340337:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785394005.340338:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785394005.340340:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785394005.340341:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785394005.340343:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785394005.340344:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785394005.340345:0:14097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785394005.340348:0:14097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1785394005.340350:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785394005.340351:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785394005.340352:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785394005.340352:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785394005.340354:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785394005.340355:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785394005.340356:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785394005.340357:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785394005.340357:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785394005.340358:0:14097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785394005.340390:0:14097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1785394005.340408:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1785394005.340475:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.340531:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2cfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.340611:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831380608 00000100:00100000:1.0:1785394005.340620:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831380608 00000100:00100000:1.0:1785394005.340666:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785394005.340675:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+5:14097:x1872120831380608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1785394005.340715:0:14110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1785394005.340717:0:14110:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1785394005.340720:0:14110:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1785394005.341097:0:14131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1785394005.341393:0:14110:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1785394005.343817:0:14132:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1785394005.343822:0:14132:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1785394005.343825:0:14132:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1785394005.343851:0:14132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1785394005.344087:0:14110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1785394005.344094:0:14110:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1785394005.380896:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+5:14097:x1872120831380608:12345-0@lo:253:mount.lustre.0 Request processed in 40213us (40412us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.380910:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394005.381011:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1785394005.381027:0:14097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1785394005.381030:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785394005.381032:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785394005.381033:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785394005.381034:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785394005.381035:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785394005.381037:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785394005.381038:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785394005.381040:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785394005.381042:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785394005.381043:0:14097:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1785394005.381061:0:14097:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93abc19f3000 from lustre-MDT0000 10000000:01000000:0.0:1785394005.381087:0:14097:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1785394005.381101:0:14097:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1785394005.381106:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93acf96619c0 10000000:01000000:0.0:1785394005.381110:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785394005.381117:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93acf96619c0 from 1 10000000:01000000:0.0:1785394005.381120:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1785394005.381156:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.381167:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.381176:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.381193:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394005.381230:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.381269:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.381363:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831380736 00000100:00100000:3.0:1785394005.381369:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831380736 00000100:00100000:3.0:1785394005.381407:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785394005.381416:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+5:14097:x1872120831380736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394005.381427:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394005.381441:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1c00/0xcc9b96d8b362a9fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362a9f6 expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.381461:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1c00/0xcc9b96d8b362a9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362a9f6 expref: 6 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.381471:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1c00/0xcc9b96d8b362a9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362a9f6 expref: 6 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.381488:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1c00, rc 0) 00000100:00100000:3.0:1785394005.381525:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+6:14097:x1872120831380736:12345-0@lo:101:mount.lustre.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.381531:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785394005.381637:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394005.381658:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.381667:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.381707:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.381728:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.381752:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:2.0:1785394005.381808:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831380864 00000100:00100000:2.0:1785394005.381812:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831380864 00000100:00100000:2.0:1785394005.381838:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785394005.381844:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+6:14097:x1872120831380864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394005.382017:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+6:14097:x1872120831380864:12345-0@lo:501:mount.lustre.0 Request processed in 172us (286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785394005.382023:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785394005.382081:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380864:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1785394005.382101:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1785394005.382123:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382130:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394005.382136:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93abc19f3000 10000000:01000000:0.0:1785394005.382139:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785394005.382142:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93abc19f3000 10000000:01000000:0.0:1785394005.382144:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1785394005.382146:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93abc19f3000 from 1 10000000:01000000:0.0:1785394005.382148:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1785394005.382160:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382166:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382172:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.382182:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394005.382204:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.382215:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.382308:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831380992 00000100:00100000:1.0:1785394005.382312:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831380992 00000100:00100000:1.0:1785394005.382330:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785394005.382336:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc13fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+6:14097:x1872120831380992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394005.382343:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394005.382352:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82bb000/0xcc9b96d8b362aa0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aa04 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382366:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82bb000/0xcc9b96d8b362aa0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa04 expref: 7 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382385:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82bb000/0xcc9b96d8b362aa0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa04 expref: 7 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382391:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb000, rc 0) 00000100:00100000:1.0:1785394005.382429:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc13fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+7:14097:x1872120831380992:12345-0@lo:101:mount.lustre.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.382435:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394005.382511:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831380992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394005.382521:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa0b expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382528:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aa0b expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394005.382545:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1785394005.382549:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa0b expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382555:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c59e00/0xcc9b96d8b362aa04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa0b expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394005.382560:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1785394005.382564:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785394005.382592:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93abc19f3000 10000000:01000000:0.0:1785394005.382596:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1785394005.382599:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1785394005.382601:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785394005.382614:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382621:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.382628:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.382645:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394005.382679:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.382699:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.382787:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831381120 00000100:00100000:1.0:1785394005.382791:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831381120 00000100:00100000:1.0:1785394005.382807:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785394005.382812:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc13f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+7:14097:x1872120831381120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394005.382818:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394005.382825:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82bb200/0xcc9b96d8b362aa19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aa12 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382842:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82bb200/0xcc9b96d8b362aa19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa12 expref: 8 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382851:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82bb200/0xcc9b96d8b362aa19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa12 expref: 8 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.382857:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb200, rc 0) 00000100:00100000:1.0:1785394005.382889:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc13f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+8:14097:x1872120831381120:12345-0@lo:101:mount.lustre.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.382895:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785394005.383015:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394005.383024:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa19 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.383037:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aa19 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.383068:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.383090:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.383114:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.383155:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831381248 00000100:00100000:1.0:1785394005.383158:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831381248 00000100:00100000:1.0:1785394005.383188:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785394005.383194:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+8:14097:x1872120831381248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785394005.383468:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14097:x1872120831381248:12345-0@lo:501:mount.lustre.0 Request processed in 274us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.383475:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785394005.383647:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.383682:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394005.383720:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.383747:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9affe40 going to sleep for 11 seconds 00000100:00100000:2.0:1785394005.383792:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831381376 00000100:00100000:2.0:1785394005.383796:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831381376 00000100:00100000:2.0:1785394005.383827:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785394005.383834:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14097:x1872120831381376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394005.384120:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14097:x1872120831381376:12345-0@lo:503:mount.lustre.0 Request processed in 286us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394005.384126:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785394005.384199:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831381376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785394005.384550:0:14133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14133:1872120831381504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785394005.384608:0:14133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394005.384622:0:14133:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785394005.384723:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831381504 00000100:00100000:2.0:1785394005.384727:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831381504 00000100:00100000:2.0:1785394005.384744:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785394005.384749:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14133:x1872120831381504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785394005.384944:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14133:x1872120831381504:12345-0@lo:502:llog_process_th.0 Request processed in 193us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394005.384951:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785394005.385074:0:14133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14133:1872120831381504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785394005.385093:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394005.385102:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.385105:0:14133:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785394005.385110:0:14133:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1785394005.385113:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785394005.385124:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93acce5d4d40) 00000020:00000080:1.0:1785394005.385139:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1785394005.385143:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1785394005.385192:0:14133:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1785394005.385199:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362aa27 00000020:00000080:1.0:1785394005.385403:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1785394005.385409:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394005.385412:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.385414:0:14133:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785394005.385417:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394005.385420:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.385421:0:14133:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1785394005.385424:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785394005.385431:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93acce5d19c0) 00000020:00000080:1.0:1785394005.385440:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1785394005.385450:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1785394005.385452:0:14133:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1785394005.385455:0:14133:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1785394005.385461:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1785394005.385515:0:14133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93abc19f3000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1785394005.385527:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93acce5d0000) 00000020:00000080:1.0:1785394005.385536:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1785394005.385608:0:14133:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1785394005.385613:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362aa3c 00000020:00000080:1.0:1785394005.385709:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1785394005.385715:0:14133:0:(mdd_device.c:1597:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1785394005.385720:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcc9b96d8b362aa43 00080000:01000000:1.0:1785394005.385725:0:14133:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1785394005.385728:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362aa4a 00010000:00010000:3.0:1785394005.697276:0:14133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1785394005.699466:0:14133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1785394005.699804:0:14133:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1785394005.700331:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93acf9664d40) 00000020:00000080:3.0:1785394005.700348:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1785394005.700401:0:14133:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1785394005.700406:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362aa58 00000020:00000080:2.0:1785394005.707272:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1785394005.710519:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcc9b96d8b362aa5f 00000020:00000080:3.0:1785394005.724746:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1785394005.724759:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394005.724766:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.724768:0:14133:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1785394005.724771:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1785394005.724774:0:14133:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1785394005.724775:0:14133:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1785394005.724777:0:14133:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1785394005.724778:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1785394005.724780:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.724782:0:14133:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1785394005.724784:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785394005.724787:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.724789:0:14133:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1785394005.724793:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1785394005.724832:0:14133:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1785394005.724845:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394005.724847:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.724849:0:14133:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1785394005.724851:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785394005.724854:0:14133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1785394005.724857:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.724858:0:14133:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1785394005.724860:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1785394005.724865:0:14133:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1785394005.724886:0:14133:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1785394005.724888:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785394005.724900:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93acf9660000) 00000020:00000080:3.0:1785394005.724915:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1785394005.724918:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1785394005.724975:0:14133:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1785394005.724980:0:14133:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1785394005.724985:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362aa6d 00010000:00080000:3.0:1785394005.725018:0:14133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acf791b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785394005.725232:0:14133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1785394005.725700:0:14133:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1785394005.725738:0:14133:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1785394005.737946:0:14133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394005.738016:0:14133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1785394005.738101:0:14133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1785394005.738557:0:14137:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785394005.738561:0:14137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1785394005.739192:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785394005.739204:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1785394005.739232:0:14133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1785394005.739251:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362aa74 00000100:00080000:2.0:1785394005.739261:0:14133:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785394005.739267:0:14133:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93acf791b800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1785394005.739297:0:14133:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d58700 x1872120831381632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785394005.739360:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831381632:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1785394005.739406:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872120831381632 offset 0 length 520: 4 00000100:00080000:2.0:1785394005.739457:0:14133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1785394005.740604:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785394005.740609:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785394005.740611:0:14133:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1785394005.740614:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1785394005.740616:0:14133:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1785394005.740618:0:14133:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785394005.740619:0:14133:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785394005.740621:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1785394005.740623:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785394005.740624:0:14133:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1785394005.740626:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785394005.740630:0:14133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1785394005.740632:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785394005.740634:0:14133:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1785394005.740636:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1785394005.740640:0:14133:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1785394005.740666:0:14133:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1785394005.740674:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785394005.740684:0:14133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93acf7250000) 00000020:00000080:2.0:1785394005.740695:0:14133:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1785394005.740699:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1785394005.740746:0:14133:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1785394005.740751:0:14133:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1785394005.740755:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcc9b96d8b362aa82 00010000:00080000:2.0:1785394005.740778:0:14133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acf6ef8800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1785394005.740967:0:14133:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1785394005.741099:0:14133:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1785394005.741114:0:14133:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1785394005.741554:0:14133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394005.741643:0:14133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1785394005.741730:0:14133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1785394005.753332:0:14139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1785394005.753341:0:14139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1785394005.754146:0:14133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785394005.754158:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1785394005.754200:0:14133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1785394005.754221:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362aa89 00000100:00080000:3.0:1785394005.754230:0:14133:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785394005.754236:0:14133:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394005.754269:0:14133:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d73480 x1872120831381760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785394005.754296:0:14133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1785394005.754347:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394005.754352:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.754354:0:14133:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1785394005.754357:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785394005.754360:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.754361:0:14133:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785394005.754364:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785394005.754365:0:14133:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785394005.754367:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394005.754369:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.754370:0:14133:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1785394005.754372:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785394005.754374:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.754375:0:14133:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1785394005.754378:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1785394005.754416:0:14133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14133:1872120831381888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.754501:0:14133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.754536:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831381888 00000100:00100000:3.0:1785394005.754543:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831381888 00000100:00100000:3.0:1785394005.754595:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785394005.754604:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14133:x1872120831381888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.754816:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+9:14133:x1872120831381888:12345-0@lo:502:llog_process_th.0 Request processed in 212us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.754823:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785394005.754867:0:14133:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad006b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.754885:0:14133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14133:1872120831381888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785394005.754905:0:14133:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394005.754908:0:14133:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394005.754909:0:14133:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785394005.754912:0:14133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1785394005.754958:0:14097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1785394005.754975:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1785394005.754990:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa19 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.755000:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c58200/0xcc9b96d8b362aa12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa19 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394005.755008:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93abc19f3000 from 1 10000000:01000000:0.0:1785394005.755011:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785394005.755033:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.755041:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.755061:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.755074:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394005.755103:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.755132:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:2.0:1785394005.755140:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831381760:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1785394005.755167:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872120831381760 offset 0 length 520: 4 00000100:00100000:3.0:1785394005.755217:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382016 00000100:00100000:3.0:1785394005.755221:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382016 00000100:00100000:3.0:1785394005.755249:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785394005.755256:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+9:14097:x1872120831382016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394005.755264:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394005.755276:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aa90 expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.755295:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 10 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.755305:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 10 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.755323:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0200, rc 0) 00000100:00100000:3.0:1785394005.755400:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+10:14097:x1872120831382016:12345-0@lo:101:mount.lustre.0 Request processed in 144us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.755406:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785394005.762628:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394005.762664:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.762677:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394005.763233:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1785394005.763299:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394005.763334:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.763470:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382144 00000100:00100000:3.0:1785394005.763477:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382144 00000100:00100000:3.0:1785394005.763526:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785394005.763534:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+10:14097:x1872120831382144:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1785394005.763552:0:14109:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1785394005.763557:0:14109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1785394005.763642:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+10:14097:x1872120831382144:12345-0@lo:256:mount.lustre.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.763659:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785394005.764581:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382144:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1785394005.765158:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785394005.765184:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.765195:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394005.765204:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93abc19f3000 from 1 10000000:01000000:0.0:1785394005.765206:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785394005.766409:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.766419:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.766427:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.766516:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394005.766562:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394005.766616:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382272 00000100:00100000:0.0:1785394005.766618:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:2.0:1785394005.766621:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382272 00000100:00100000:2.0:1785394005.766665:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785394005.766673:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+10:14097:x1872120831382272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785394005.766685:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394005.766698:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aa9e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.766717:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.766726:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.766747:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785394005.766791:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382272:12345-0@lo:101:mount.lustre.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394005.766798:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785394005.768405:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394005.768423:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.768433:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394005.768495:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.768531:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.768580:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.768682:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382400 00000100:00100000:3.0:1785394005.768687:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382400 00000100:00100000:3.0:1785394005.768721:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785394005.768729:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394005.769092:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382400:12345-0@lo:501:mount.lustre.0 Request processed in 363us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.769099:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785394005.769380:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.769416:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394005.769537:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.769584:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.771592:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382528 00000100:00100000:3.0:1785394005.771598:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382528 00000100:00100000:3.0:1785394005.771628:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785394005.771634:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785394005.771801:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382528:12345-0@lo:503:mount.lustre.0 Request processed in 166us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.771812:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785394005.772622:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394005.777509:0:14141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14141:1872120831382656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785394005.777601:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.777640:0:14141:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef000 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.781599:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382656 00000100:00100000:3.0:1785394005.781611:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382656 00000100:00100000:3.0:1785394005.781683:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785394005.781694:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+11:14141:x1872120831382656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.781972:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+11:14141:x1872120831382656:12345-0@lo:502:llog_process_th.0 Request processed in 279us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.781980:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785394005.782614:0:14141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14141:1872120831382656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785394005.782645:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394005.782664:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.782666:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1785394005.782681:0:14141:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93abc19f3000 00000020:00000080:1.0:1785394005.782684:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394005.782702:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394005.782705:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.782706:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1785394005.782709:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394005.782712:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.782713:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785394005.782716:0:14141:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93abc19f3000 00000020:00000080:1.0:1785394005.782718:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394005.782774:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394005.782778:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.782780:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1785394005.782782:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394005.782785:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394005.782786:0:14141:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785394005.782789:0:14141:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93abc19f3000 00000020:00000080:1.0:1785394005.782791:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785394005.782837:0:14141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14141:1872120831382784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785394005.782877:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394005.782910:0:14141:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc83f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1785394005.783318:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382784 00000100:00100000:0.0:1785394005.783323:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382784 00000100:00100000:0.0:1785394005.783350:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785394005.783357:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+11:14141:x1872120831382784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785394005.783622:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+11:14141:x1872120831382784:12345-0@lo:502:llog_process_th.0 Request processed in 264us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394005.783636:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785394005.783689:0:14141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14141:1872120831382784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785394005.783709:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785394005.783713:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394005.783715:0:14141:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785394005.783719:0:14141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785394005.785673:0:14097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1785394005.785696:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785394005.785713:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.785725:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785394005.785768:0:14097:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785394005.785771:0:14097:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93abc19f3000 10000000:01000000:3.0:1785394005.785774:0:14097:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93abc19f3000 10000000:01000000:3.0:1785394005.785778:0:14097:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785394005.785783:0:14097:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93abc19f3000 from 1 10000000:01000000:3.0:1785394005.785786:0:14097:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785394005.785814:0:14097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.785823:0:14097:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.785832:0:14097:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394005.785856:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785394005.785896:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.785920:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394005.786339:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831382912 00000100:00100000:0.0:1785394005.786345:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831382912 00000100:00100000:0.0:1785394005.786376:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785394005.786383:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831382912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394005.786394:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394005.786415:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c59c00/0xcc9b96d8b362aab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aaac expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.786434:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c59c00/0xcc9b96d8b362aab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aaac expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.786496:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c59c00/0xcc9b96d8b362aab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aaac expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.786505:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59c00, rc 0) 00000100:00100000:0.0:1785394005.786540:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831382912:12345-0@lo:101:mount.lustre.0 Request processed in 157us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394005.786546:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785394005.798682:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831382912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394005.798713:0:14097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aab3 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394005.798727:0:14097:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aab3 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394005.798799:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394005.798851:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.798888:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394005.799385:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383040 00000100:00100000:0.0:1785394005.799402:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383040 00000100:00100000:0.0:1785394005.799452:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785394005.799461:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831383040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394005.799746:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831383040:12345-0@lo:501:mount.lustre.0 Request processed in 285us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394005.799755:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785394005.799773:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394005.799805:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394005.799843:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394005.799870:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc65dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1785394005.800360:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383168 00000100:00100000:0.0:1785394005.800365:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383168 00000100:00100000:0.0:1785394005.800402:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785394005.800408:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831383168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394005.800656:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831383168:12345-0@lo:503:mount.lustre.0 Request processed in 238us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394005.800663:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785394005.800671:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785394005.802899:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14146:1872120831383296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.802938:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.802970:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d240 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.803009:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383296 00000100:00100000:1.0:1785394005.803013:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383296 00000100:00100000:1.0:1785394005.803045:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785394005.803052:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14146:x1872120831383296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785394005.803210:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14146:x1872120831383296:12345-0@lo:502:llog_process_th.0 Request processed in 157us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.803216:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785394005.804677:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14146:1872120831383296:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1785394005.804730:0:14146:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1785394005.804743:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93acc953b380) 00000020:00000080:3.0:1785394005.804761:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1785394005.807328:0:14146:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93abc19f3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785394005.807335:0:14146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93abc19f3000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785394005.807338:0:14146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93abc19f3000 4 00010000:00080000:3.0:1785394005.807368:0:14146:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93acf2e00000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1785394005.831901:0:14146:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1785394005.832006:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1785394005.832040:0:14146:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785394005.832050:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcc9b96d8b362aac1 00000100:00080000:3.0:1785394005.832059:0:14146:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785394005.832064:0:14146:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93acf2e00000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394005.832095:0:14146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d72300 x1872120831383424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785394005.832123:0:14146:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785394005.832978:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831383424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785394005.833039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394005.833102:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383424 00000100:00100000:0.0:1785394005.833108:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383424 00000100:00100000:0.0:1785394005.833132:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785394005.833138:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831383424:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785394005.833179:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831383424:12345-0@lo:38:llog_process_th.0 Request processed in 40us (139us total) trans 0 rc -11/-11 00000100:00100000:0.0:1785394005.833184:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785394005.833209:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785394005.833216:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf2e00000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785394005.833219:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1785394005.833222:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831383424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1785394005.837388:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14146:1872120831383552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.837456:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394005.837640:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383552 00000100:00100000:3.0:1785394005.837655:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383552 00000100:00100000:3.0:1785394005.837694:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785394005.837702:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14146:x1872120831383552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785394005.837921:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14146:x1872120831383552:12345-0@lo:502:llog_process_th.0 Request processed in 219us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394005.837928:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785394005.837997:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394005.838015:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:daecb8d0-f73c-4aec-8915-f89616659996:14146:1872120831383552:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1785394005.838039:0:14146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1785394005.850607:0:14097:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1785394005.850643:0:14097:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785394005.850672:0:14097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aab3 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.850685:0:14097:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f0e00/0xcc9b96d8b362aaac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aab3 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785394005.850743:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785394005.850745:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785394005.850746:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785394005.850747:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785394005.850748:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785394005.850749:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785394005.850750:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785394005.850751:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785394005.850753:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785394005.850754:0:14097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785394005.850757:0:14097:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1785394005.850763:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785394005.850764:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785394005.850765:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785394005.850766:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785394005.850767:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785394005.850768:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785394005.850769:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785394005.850769:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785394005.850770:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785394005.850771:0:14097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785394005.850805:0:14097:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1785394005.850822:0:14097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785394005.850879:0:14097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394005.850920:0:14097:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc65dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1785394005.851220:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383680 00000100:00100000:0.0:1785394005.851227:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383680 00000100:00100000:0.0:1785394005.851319:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785394005.851333:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14097:x1872120831383680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785394005.851357:0:14109:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1785394005.851369:0:14109:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1785394005.961227:0:14109:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785394005.961238:0:14109:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1785394005.961251:0:14131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1785394005.961257:0:14131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1785394005.961277:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.961294:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.961303:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.961340:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394005.961354:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 12 pid: 14108 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394005.961367:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831383808:0@lo:104: 00000100:00100000:2.0:1785394005.961426:0:14131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394005.961502:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc65dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1785394005.961700:0:14098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383808 00000100:00100000:1.0:1785394005.961712:0:14098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383808 00000100:00100000:1.0:1785394005.961756:0:14098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785394005.961764:0:14098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831383808:12345-0@lo:104: 00010000:00010000:1.0:1785394005.961777:0:14098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961842:0:14098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785394005.961849:0:14098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831383808:12345-0@lo:104: Request processed in 85us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.961857:0:14098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1785394005.961878:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394005.961884:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961892:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58400 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785394005.961896:0:14104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961905:0:14104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785394005.961914:0:14104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394005.961920:0:14104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1785394005.961927:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831383808:0@lo:104: 00010000:00010000:2.0:1785394005.961946:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961950:0:14104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961959:0:14104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785394005.961974:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.961987:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acd7c58400/0xcc9b96d8b362aa90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aa97 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394005.961996:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831383936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394005.962004:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394005.962008:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394005.962010:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394005.962028:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394005.962158:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831383936 00000100:00100000:1.0:1785394005.962203:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831383936 00010000:00010000:1.0:1785394005.962221:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 13 pid: 14108 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394005.962245:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785394005.962261:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+13:3316:x1872120831383936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394005.962271:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394005.962276:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 13 pid: 14108 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962288:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 13 pid: 14108 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962416:0:14100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f0200/0xcc9b96d8b362aa97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362aa90 expref: 13 pid: 14108 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962429:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962437:0:14100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785394005.962458:0:14100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001202396s 00010000:00010000:1.0:1785394005.962463:0:14100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962470:0:14100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962477:0:14100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962484:0:14100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962490:0:14100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394005.962494:0:14100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962502:0:14100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962522:0:14100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394005.962531:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394005.962558:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+12:3316:x1872120831383936:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394005.962565:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1785394005.964560:0:14131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.964591:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394005.964597:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0400/0xcc9b96d8b362aac8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394005.969666:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831383936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394005.984704:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394005.994900:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+11:14097:x1872120831383680:12345-0@lo:253:mount.lustre.0 Request processed in 143560us (144012us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394005.994914:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785394005.995021:0:14097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14097:1872120831383680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1785394005.995036:0:14097:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1785394005.995039:0:14097:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785394005.995041:0:14097:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785394005.995042:0:14097:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785394005.995044:0:14097:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785394005.995045:0:14097:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785394005.995047:0:14097:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785394005.995048:0:14097:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785394005.995050:0:14097:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785394005.995051:0:14097:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785394005.995052:0:14097:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785394005.995066:0:14097:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785394006.008752:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394006.008925:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394006.009204:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394006.009369:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394006.012904:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394006.013093:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394006.020976:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394006.021147:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394006.021430:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1785394006.031948:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1785394006.032246:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1785394006.032407:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1785394006.107468:0:14097:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1785394006.117417:0:14097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1785394006.117897:0:14153:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1785394006.117902:0:14153:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1785394006.117970:0:14154:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1785394006.118077:0:14154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785394006.133700:0:14154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1785394006.133784:0:14154:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1785394006.133789:0:14154:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1785394006.138825:0:14097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1785394006.138987:0:14097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1785394006.141834:0:14097:0:(mdd_device.c:554:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1785394006.141850:0:14097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1785394006.142051:0:14097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785394006.149063:0:14097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1785394006.152184:0:14097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1785394006.155395:0:14097:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1785394006.156774:0:14097:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1785394006.183622:0:14097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1785394006.308778:0:14097:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1785394006.308815:0:14097:0:(mdd_device.c:2303:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa33d01c87988 00100000:10000000:0.0:1785394006.308822:0:14097:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1785394006.312636:0:14097:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785394006.312666:0:14097:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785394006.312680:0:14097:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1785394006.312703:0:14097:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:1.0:1785394006.475169:0:14112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1785394006.475177:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93abc19f3000 from 6 10000000:01000000:1.0:1785394006.475182:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785394006.475239:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394006.475252:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394006.475263:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394006.475288:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831384064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785394006.475355:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394006.475425:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8f23180 going to sleep for 11 seconds 00000100:00100000:2.0:1785394006.475763:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384064 00000100:00100000:2.0:1785394006.475770:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384064 00000100:00100000:2.0:1785394006.475815:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785394006.475824:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+11:14112:x1872120831384064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785394006.475838:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394006.475851:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aacf expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394006.475871:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 12 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394006.475880:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 12 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394006.475889:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1200, rc 0) 00000100:00100000:2.0:1785394006.475928:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831384064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394006.475936:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785394006.475981:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831384064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785394006.475995:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394006.476004:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394006.476055:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831384192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1785394006.476088:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394006.476121:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1785394006.480179:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384192 00000100:00100000:1.0:1785394006.480190:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384192 00000100:00100000:1.0:1785394006.480254:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785394006.480263:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831384192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1785394006.480284:0:14108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785394006.480303:0:14108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785394006.480306:0:14108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1785394006.480421:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831384192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (4332us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394006.480444:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785394006.483405:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831384192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1785394006.483487:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785394006.483496:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394006.483506:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785394006.881313:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785394007.015763:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785394007.906247:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785394008.036188:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394009.056738:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394010.080331:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394011.108624:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785394011.167722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394011.167728:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1785394011.167732:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394011.167734:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1785394011.167737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1785394011.167740:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1785394011.167744:0:36:0:(import.c:65:import_set_state_nolock()) ffff93acf2e00000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785394011.167755:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93acf2e00000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394011.167777:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d72680 x1872120831384448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785394011.168339:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831384320:0@lo:400:kworker.0 00000100:00100000:0.0:1785394011.168411:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394011.168495:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831384448:0@lo:38:kworker.0 00000100:00100000:0.0:1785394011.168521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394011.168685:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384320 00000100:00100000:3.0:1785394011.168692:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384320 00000100:00100000:3.0:1785394011.168738:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785394011.168747:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:3317:x1872120831384320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394011.168793:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:3317:x1872120831384320:12345-0@lo:400:kworker.0 Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394011.168800:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785394011.169549:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831384320:0@lo:400:kworker.0 00000100:00100000:0.0:1785394011.171838:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384448 00000100:00100000:0.0:1785394011.171848:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384448 00000100:00100000:0.0:1785394011.171887:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394011.171893:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1872120831384448:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1785394011.171918:0:14117:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1785394011.171951:0:14117:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcc9b96d8b362aadd 00000004:00100000:0.0:1785394011.171966:0:14117:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785394011.172093:0:14117:0:(import.c:65:import_set_state_nolock()) ffff93acc7a8d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785394011.172161:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1872120831384448:12345-0@lo:38:kworker.0 Request processed in 266us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394011.172168:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785394011.172206:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acf7d72680 x1872120831384448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785394021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1785394011.172221:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1785394011.172228:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1785394011.172233:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785394011.172235:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf2e00000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785394011.172241:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1872120831384448:0@lo:38:kworker.0 00010000:00010000:0.0:1785394012.139885:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785394012.583986:0:14397:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785394013.151829:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394014.182070:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394015.204711:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785394015.266776:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785394005/real 1785394005] req@ffff93acf7d73480 x1872120831381760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394015.266807:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93acf7d73480 x1872120831381760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394015.266816:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785394005/real 1785394005] req@ffff93acf7d58700 x1872120831381632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394015.266841:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93acf7d58700 x1872120831381632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785394015.266857:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785394015.266884:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785394015.266888:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831381760:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1785394015.266894:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf791b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785394015.266898:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785394015.266901:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831381632:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1785394015.267090:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394015.267095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1785394015.267097:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf791b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785394015.267102:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1785394015.267106:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785394015.267112:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93acf791b800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785394015.267129:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9631c00 x1872120831384704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785394015.267141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394015.267143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785394015.267145:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785394015.267148:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1785394015.267151:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785394015.267154:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785394015.267161:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9632680 x1872120831384832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785394015.267196:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831384960:0@lo:400:kworker.0 00000100:00100000:1.0:1785394015.267256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394015.267356:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394015.267365:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831384576:0@lo:400:kworker.0 00000100:00100000:3.0:1785394015.267399:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394015.267462:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384960 00000100:00100000:3.0:1785394015.267470:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384960 00000100:00100000:3.0:1785394015.267507:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785394015.267515:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831384960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394015.267565:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831384960:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394015.267611:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785394015.267652:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acf9633b80 x1872120831384960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394015.267664:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831384960:0@lo:400:kworker.0 00000100:00100000:3.0:1785394015.267681:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831384704:0@lo:8:kworker.0 00000400:00000100:3.0:1785394015.267701:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872120831384704 offset 0 length 520: 4 00000100:00100000:3.0:1785394015.267722:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831384832:0@lo:8:kworker.0 00000400:00000100:3.0:1785394015.267740:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872120831384832 offset 0 length 520: 4 00000100:00100000:1.0:1785394015.267852:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831384576 00000100:00100000:1.0:1785394015.267857:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831384576 00000100:00100000:1.0:1785394015.267891:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785394015.267898:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:3317:x1872120831384576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394015.267937:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:3317:x1872120831384576:12345-0@lo:400:kworker.0 Request processed in 39us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394015.267943:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785394015.267975:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831384576:0@lo:400:kworker.0 00010000:00010000:0.0:1785394016.223672:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785394016.829997:0:14547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc965d6740 20000000:00000080:1.0:1785394016.830014:0:14547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93acfa9a5000 uarg=0000000000000000 20000000:01000000:1.0:1785394016.830045:0:14547:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1785394016.830052:0:14547:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1785394016.830057:0:14547:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1785394016.833057:0:14548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1785394016.833178:0:14547:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1785394016.840492:0:14547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785394016.840520:0:14547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.840536:0:14547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.840543:0:14547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.841557:0:14547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.841594:0:14547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394016.841609:0:14547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14547:1872120831385088:0@lo:104: 00000100:00100000:2.0:1785394016.841669:0:14547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394016.841738:0:14547:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc11ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785394016.841917:0:14099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385088 00000100:00100000:3.0:1785394016.841925:0:14099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385088 00000100:00100000:3.0:1785394016.841972:0:14099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785394016.841980:0:14099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:14547:x1872120831385088:12345-0@lo:104: 00010000:00010000:3.0:1785394016.841992:0:14099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394016.842050:0:14099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785394016.842056:0:14099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:14547:x1872120831385088:12345-0@lo:104: Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394016.842063:0:14099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1785394016.842127:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394016.842133:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842141:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c59a00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785394016.842145:0:14104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842153:0:14104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785394016.842159:0:14104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394016.842164:0:14104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785394016.842206:0:14104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842213:0:14104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785394016.842238:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842245:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acd7c59a00/0xcc9b96d8b362aa9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaa5 expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842259:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394016.842261:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394016.842263:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394016.842298:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831385216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785394016.842329:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394016.842423:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385216 00000100:00100000:1.0:1785394016.842427:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385216 00010000:00010000:1.0:1785394016.842446:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 12 pid: 14110 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394016.842473:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785394016.842479:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+12:3316:x1872120831385216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394016.842489:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394016.842494:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 12 pid: 14110 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842504:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 12 pid: 14110 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842519:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842526:0:14100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842544:0:14100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842550:0:14100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842556:0:14100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842562:0:14100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842603:0:14100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394016.842608:0:14100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842616:0:14100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842624:0:14100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394016.842633:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394016.842667:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+12:3316:x1872120831385216:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394016.842673:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785394016.842749:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831385216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785394016.843273:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1400/0xcc9b96d8b362aaa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362aa9e expref: 11 pid: 14110 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394016.843282:0:14547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14547:1872120831385088:0@lo:104: 00010000:00010000:2.0:1785394016.843293:0:14547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.843302:0:14547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.843307:0:14547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394016.843312:0:14547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362aae4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785394017.120406:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785394017.248849:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394018.272915:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785394018.399695:0:14112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785394018.399706:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93abc19f3000 from 10 10000000:01000000:3.0:1785394018.399714:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785394018.399778:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394018.399793:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394018.399808:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394018.399839:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785394018.399924:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394018.400024:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc955ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1785394018.400182:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385344 00000100:00100000:0.0:1785394018.400191:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385344 00000100:00100000:0.0:1785394018.400253:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785394018.400263:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+11:14112:x1872120831385344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785394018.400280:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394018.400296:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aaeb expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394018.400322:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394018.400334:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394018.400345:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58400, rc 0) 00000100:00100000:0.0:1785394018.400397:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831385344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394018.400404:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785394018.400735:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394018.400750:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394018.400760:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394018.400817:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394018.400843:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394018.400870:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc955ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1785394018.400917:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385472 00000100:00100000:1.0:1785394018.400922:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385472 00000100:00100000:1.0:1785394018.400950:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785394018.400963:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831385472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394018.401236:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831385472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394018.401244:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785394018.401338:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394018.401383:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785394018.401421:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394018.401441:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc955ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1785394018.401489:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385600 00000100:00100000:1.0:1785394018.401493:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385600 00000100:00100000:1.0:1785394018.401518:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785394018.401524:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831385600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394018.401707:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14112:x1872120831385600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394018.401714:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785394018.401788:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831385600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785394018.402630:0:14578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785394018.404797:0:14112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785394018.404831:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785394018.404844:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394018.404857:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394019.298171:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394020.332604:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785394020.391398:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785394020.391406:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1785394020.391409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785394020.391413:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1785394020.391443:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785394020.391469:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831385728:0@lo:400:kworker.0 00000100:00100000:0.0:1785394020.391567:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394020.391659:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385728 00000100:00100000:0.0:1785394020.391667:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385728 00000100:00100000:0.0:1785394020.391720:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785394020.391730:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:3318:x1872120831385728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394020.391792:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:3318:x1872120831385728:12345-0@lo:400:kworker.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394020.391800:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785394020.391855:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831385728:0@lo:400:kworker.0 00000100:00100000:0.0:1785394020.391895:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831385856:0@lo:400:kworker.0 00000100:00100000:0.0:1785394020.391924:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394020.391956:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385856 00000100:00100000:0.0:1785394020.391960:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385856 00000100:00100000:0.0:1785394020.391991:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394020.391997:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394020.392036:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831385856:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394020.392042:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1785394020.392074:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ad003c8700 x1872120831385856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785394020.392087:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831385856:0@lo:400:kworker.0 00010000:00010000:0.0:1785394021.350808:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394022.368747:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1785394022.731121:0:14749:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1785394022.731133:0:14749:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1785394022.731247:0:14749:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93acc7a88800 00000020:01000004:0.0:1785394022.731260:0:14749:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1785394022.731272:0:14749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1785394022.731285:0:14749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93acc85a3380) 00000020:00000080:0.0:1785394022.731300:0:14749:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785394022.782960:0:14749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785394022.783230:0:14749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785394022.790598:0:14749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785394022.792015:0:14749:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1785394022.792296:0:14749:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1785394022.795036:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 581: rc = 0 00100000:10000000:2.0:1785394022.795136:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 581: rc = 0 00100000:10000000:2.0:1785394022.795228:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 581: rc = 0 00100000:10000000:2.0:1785394022.795822:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 195: rc = 0 00100000:10000000:2.0:1785394022.796062:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 195: rc = 0 00100000:10000000:2.0:1785394022.796313:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 195: rc = 0 00100000:10000000:2.0:1785394022.796586:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 195: rc = 0 00100000:10000000:3.0:1785394022.802068:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 195: rc = 0 00100000:10000000:3.0:1785394022.802353:0:14749:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 195: rc = 0 00000020:00000080:3.0:1785394022.803831:0:14749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1785394022.803841:0:14749:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785394022.803851:0:14749:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc9b96d8b362ab00 00000020:01000004:3.0:1785394022.803859:0:14749:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1785394022.803879:0:14749:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785394022.803882:0:14749:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785394022.803888:0:14749:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1785394022.803893:0:14749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1785394022.803903:0:14749:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93acc9538000) 00000020:00000080:3.0:1785394022.803913:0:14749:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1785394022.814154:0:14749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785394022.814315:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1785394022.814320:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1785394022.815517:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1785394022.815525:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1785394022.827898:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1785394022.827912:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1785394022.829909:0:14749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785394022.830062:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1785394022.830068:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1785394022.836138:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1785394022.836150:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1785394022.864470:0:14749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785394022.865950:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1785394022.865956:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1785394022.876936:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1785394022.877017:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1785394022.877748:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1785394022.877755:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1785394022.885996:0:14749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785394022.886152:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1785394022.886157:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1785394022.893445:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1785394022.893460:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1785394022.965048:0:14749:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785394022.965222:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1785394022.965228:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1785394022.967973:0:14749:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1785394022.967981:0:14749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1785394022.972287:0:14749:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1785394022.972311:0:14749:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1785394022.972318:0:14749:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1785394022.994512:0:14749:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1785394022.994557:0:14749:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1785394022.994562:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1785394022.994564:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785394022.994565:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785394022.994566:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785394022.994567:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785394022.994605:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785394022.994607:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785394022.994609:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785394022.994610:0:14749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785394022.994614:0:14749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1785394022.994616:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785394022.994617:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785394022.994619:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785394022.994620:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785394022.994626:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785394022.994628:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785394022.994629:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785394022.994630:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785394022.994630:0:14749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785394022.994654:0:14749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785394022.994674:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831385984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785394022.998689:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394022.998743:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd05f1300 going to sleep for 11 seconds 00000100:00100000:3.0:1785394022.998781:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831385984 00000100:00100000:3.0:1785394022.998789:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831385984 00000100:00100000:3.0:1785394022.998844:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785394022.998854:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14749:x1872120831385984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1785394022.998902:0:14108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1785394022.998906:0:14108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1785394022.998909:0:14108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1785394023.041423:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+12:14749:x1872120831385984:12345-0@lo:253:mount.lustre.0 Request processed in 42562us (42731us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.041438:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785394023.041624:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831385984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785394023.041638:0:14749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1785394023.041642:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785394023.041644:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785394023.041645:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394023.041646:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394023.041647:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394023.041649:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394023.041651:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394023.041652:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394023.041654:0:14749:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785394023.041673:0:14749:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93acc7a88800 from lustre-OST0000 10000000:01000000:3.0:1785394023.041712:0:14749:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1785394023.041715:0:14749:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1785394023.041721:0:14749:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93acf96619c0 local copy 00010000:00010000:3.0:1785394023.041731:0:14749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394023.041946:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394023.041982:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.042006:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.042287:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386112 00000100:00100000:0.0:1785394023.042294:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386112 00000100:00100000:0.0:1785394023.042337:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785394023.042345:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14749:x1872120831386112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394023.042504:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+12:14749:x1872120831386112:12345-0@lo:501:mount.lustre.0 Request processed in 159us (520us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785394023.042511:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785394023.042627:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1785394023.042639:0:14749:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1785394023.042855:0:14749:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1785394023.042862:0:14749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.042871:0:14749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785394023.042889:0:14749:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93acc7a88800 10000000:01000000:3.0:1785394023.042895:0:14749:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1785394023.042899:0:14749:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93acf96619c0 10000000:01000000:3.0:1785394023.042901:0:14749:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1785394023.042904:0:14749:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff93acf96619c0 from 1 10000000:01000000:3.0:1785394023.042907:0:14749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1785394023.042930:0:14749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.042938:0:14749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.042947:0:14749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394023.042968:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785394023.042993:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.043021:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.043093:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386240 00000100:00100000:1.0:1785394023.043098:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386240 00000100:00100000:1.0:1785394023.043124:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785394023.043130:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+12:14749:x1872120831386240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394023.043139:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394023.043152:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82bae00/0xcc9b96d8b362ab15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ab0e expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.043182:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82bae00/0xcc9b96d8b362ab15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab0e expref: 13 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.043192:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82bae00/0xcc9b96d8b362ab15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab0e expref: 13 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.043199:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bae00, rc 0) 00000100:00100000:1.0:1785394023.043228:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+13:14749:x1872120831386240:12345-0@lo:101:mount.lustre.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.043234:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785394023.043549:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394023.043561:0:14749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab15 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.043595:0:14749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ab15 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785394023.043612:0:14749:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1785394023.043621:0:14749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab15 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.043628:0:14749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f1600/0xcc9b96d8b362ab0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab15 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785394023.043634:0:14749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1785394023.043638:0:14749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785394023.043642:0:14749:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1785394023.043644:0:14749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1785394023.043657:0:14749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.043664:0:14749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.043671:0:14749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394023.043689:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785394023.044457:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.044486:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.044546:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386368 00000100:00100000:1.0:1785394023.044551:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386368 00000100:00100000:0.0:1785394023.044651:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785394023.044660:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+13:14749:x1872120831386368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394023.044667:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394023.044675:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c58e00/0xcc9b96d8b362ab23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ab1c expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.044689:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c58e00/0xcc9b96d8b362ab23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab1c expref: 14 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.045678:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c58e00/0xcc9b96d8b362ab23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab1c expref: 14 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.045688:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58e00, rc 0) 00000100:00100000:0.0:1785394023.045823:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386368:12345-0@lo:101:mount.lustre.0 Request processed in 1164us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.045844:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785394023.045962:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394023.045975:0:14749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab23 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.045984:0:14749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ab23 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785394023.046953:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1785394023.052508:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394023.054064:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.054115:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1785394023.054146:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1785394023.054197:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1785394023.054237:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1785394023.054273:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1785394023.054339:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1785394023.054347:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1785394023.055528:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.055654:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.055788:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2f72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.055849:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386496 00000100:00100000:0.0:1785394023.055856:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386496 00000100:00100000:0.0:1785394023.055904:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785394023.055913:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394023.056263:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386496:12345-0@lo:501:mount.lustre.0 Request processed in 351us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.056271:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785394023.056656:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.056688:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394023.057637:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.057659:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace2f72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.057800:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386624 00000100:00100000:0.0:1785394023.057806:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386624 00000100:00100000:0.0:1785394023.057838:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785394023.057846:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394023.058191:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386624:12345-0@lo:503:mount.lustre.0 Request processed in 346us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.058199:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785394023.065512:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785394023.066238:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785394023.066314:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394023.066459:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.066598:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8f239c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.071012:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386752 00000100:00100000:1.0:1785394023.071026:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386752 00000100:00100000:1.0:1785394023.071076:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785394023.071084:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394023.071479:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386752:12345-0@lo:502:mount.lustre.0 Request processed in 395us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.071487:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1785394023.071620:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.072080:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.072134:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1785394023.072166:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1785394023.072225:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1785394023.072260:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1785394023.072290:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1785394023.072337:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1785394023.072447:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1785394023.072486:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1785394023.072531:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1785394023.074499:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1785394023.074876:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1785394023.074925:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785394023.074997:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394023.075034:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acda7bf900 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.075102:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831386880 00000100:00100000:1.0:1785394023.075108:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831386880 00000100:00100000:1.0:1785394023.075158:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785394023.075167:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394023.076480:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831386880:12345-0@lo:502:mount.lustre.0 Request processed in 1311us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.076489:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785394023.083525:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831386880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.090007:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1785394023.090028:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1785394023.098658:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785394023.098672:0:14764:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1785394023.098679:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394023.098682:0:14764:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1785394023.098882:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785394023.098899:0:14764:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93acc85a4d40) 00000020:00000080:0.0:1785394023.098923:0:14764:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785394023.098937:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785394023.099003:0:14764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc7a88800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1785394023.099012:0:14764:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785394023.099019:0:14764:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcc9b96d8b362ab31 00010000:00010000:1.0:1785394023.111066:0:14764:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1785394023.111453:0:14764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1785394023.115204:0:14764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1785394023.120176:0:14764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1785394023.120188:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394023.120195:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120197:0:14764:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1785394023.120201:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1785394023.120204:0:14764:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1785394023.120206:0:14764:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1785394023.120207:0:14764:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1785394023.120208:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1785394023.120211:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120212:0:14764:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1785394023.120214:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785394023.120217:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120218:0:14764:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785394023.120221:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785394023.120223:0:14764:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785394023.120225:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394023.120234:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120236:0:14764:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1785394023.120239:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785394023.120241:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120243:0:14764:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1785394023.120245:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1785394023.120303:0:14764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785394023.120306:0:14764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785394023.120308:0:14764:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785394023.120311:0:14764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1785394023.124634:0:14749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1785394023.124671:0:14749:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1785394023.124704:0:14749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab23 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.124716:0:14749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f1200/0xcc9b96d8b362ab1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab23 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394023.124724:0:14749:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc7a88800 from 1 10000000:01000000:0.0:1785394023.124727:0:14749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785394023.124762:0:14749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.124770:0:14749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394023.124780:0:14749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394023.124804:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785394023.124864:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394023.124901:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af8540 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.125958:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387008 00000100:00100000:1.0:1785394023.125966:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387008 00000100:00100000:1.0:1785394023.126004:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785394023.126013:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+14:14749:x1872120831387008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394023.126026:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394023.126038:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ab38 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.126062:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 15 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.126073:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 15 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.126081:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba600, rc 0) 00000100:00100000:1.0:1785394023.126129:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387008:12345-0@lo:101:mount.lustre.0 Request processed in 117us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.126136:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785394023.127483:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785394023.127501:0:14749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.127511:0:14749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785394023.128140:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1785394023.130904:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394023.131178:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.131224:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1785394023.131294:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1785394023.131303:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1785394023.131474:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.131543:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.132441:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394023.135541:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387136 00000100:00100000:3.0:1785394023.135551:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387136 00000100:00100000:3.0:1785394023.138747:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785394023.138765:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394023.139045:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387136:12345-0@lo:501:mount.lustre.0 Request processed in 287us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394023.139053:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785394023.139606:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.139656:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394023.139716:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.139743:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.139832:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387264 00000100:00100000:0.0:1785394023.139839:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387264 00000100:00100000:0.0:1785394023.139870:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785394023.139877:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394023.140031:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387264:12345-0@lo:503:mount.lustre.0 Request processed in 155us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.140037:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785394023.140275:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785394023.141024:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785394023.141082:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394023.141120:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.141152:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.141195:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387392 00000100:00100000:1.0:1785394023.141201:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387392 00000100:00100000:1.0:1785394023.141241:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785394023.141248:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394023.141413:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387392:12345-0@lo:502:mount.lustre.0 Request processed in 165us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.141420:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785394023.141851:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.142094:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.142141:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1785394023.142188:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1785394023.142229:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1785394023.142264:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1785394023.142310:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1785394023.142347:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1785394023.142985:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1785394023.143013:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394023.143059:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.143124:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394023.149434:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387520 00000100:00100000:3.0:1785394023.149447:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387520 00000100:00100000:3.0:1785394023.149501:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785394023.149510:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785394023.150124:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387520:12345-0@lo:502:mount.lustre.0 Request processed in 614us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394023.150131:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1785394023.150212:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.150345:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1785394023.150359:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1785394023.154043:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394023.154056:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154058:0:14768:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1785394023.154065:0:14768:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc7a88800 00000020:00000080:1.0:1785394023.154068:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394023.154076:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394023.154079:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154080:0:14768:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1785394023.154082:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394023.154085:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154086:0:14768:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785394023.154090:0:14768:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acc7a88800 00000020:00000080:1.0:1785394023.154092:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394023.154150:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394023.154154:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154155:0:14768:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1785394023.154158:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394023.154160:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154161:0:14768:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785394023.154165:0:14768:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93acc7a88800 00000020:00000080:1.0:1785394023.154167:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394023.154202:0:14768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394023.154206:0:14768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394023.154207:0:14768:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785394023.154210:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1785394023.154373:0:14749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1785394023.154403:0:14749:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785394023.154423:0:14749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.154436:0:14749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785394023.154489:0:14749:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785394023.154492:0:14749:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93acc7a88800 10000000:01000000:3.0:1785394023.154495:0:14749:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93acc7a88800 10000000:01000000:3.0:1785394023.154499:0:14749:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785394023.154504:0:14749:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acc7a88800 from 1 10000000:01000000:3.0:1785394023.154507:0:14749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785394023.154547:0:14749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.154556:0:14749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.154566:0:14749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394023.154613:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785394023.154673:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394023.154945:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387648 00000100:00100000:1.0:1785394023.154952:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387648 00000100:00100000:1.0:1785394023.155005:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785394023.155014:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831387648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394023.155028:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394023.155039:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82bb600/0xcc9b96d8b362ab4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ab46 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.155062:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82bb600/0xcc9b96d8b362ab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab46 expref: 16 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.155073:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82bb600/0xcc9b96d8b362ab4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab46 expref: 16 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.155081:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82bb600, rc 0) 00000100:00100000:3.0:1785394023.155134:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0180 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.177586:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831387648:12345-0@lo:101:mount.lustre.0 Request processed in 22548us (22888us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.177600:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785394023.183524:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785394023.183561:0:14749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab4d expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.183596:0:14749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ab4d expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785394023.186108:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1785394023.186389:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394023.186661:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.186719:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1785394023.186757:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1785394023.186807:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1785394023.186846:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1785394023.186907:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1785394023.186949:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1785394023.186981:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1785394023.187043:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1785394023.187080:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1785394023.187111:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1785394023.187158:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1785394023.187196:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1785394023.187230:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1785394023.187283:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1785394023.187320:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1785394023.187356:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1785394023.187422:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1785394023.187461:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1785394023.187499:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1785394023.187563:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1785394023.187625:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1785394023.187656:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1785394023.187696:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1785394023.187730:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1785394023.187764:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1785394023.187826:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1785394023.187865:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1785394023.187936:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1785394023.187945:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1785394023.188025:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.188086:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.188137:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422be40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394023.188427:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387776 00000100:00100000:3.0:1785394023.188434:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387776 00000100:00100000:3.0:1785394023.188479:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785394023.188488:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831387776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394023.189837:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831387776:12345-0@lo:501:mount.lustre.0 Request processed in 1346us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394023.189847:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785394023.196601:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394023.196668:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394023.200657:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.200699:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.200782:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831387904 00000100:00100000:1.0:1785394023.200790:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831387904 00000100:00100000:1.0:1785394023.200848:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785394023.200858:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831387904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785394023.201031:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831387904:12345-0@lo:503:mount.lustre.0 Request processed in 174us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.201038:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785394023.201190:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831387904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785394023.203097:0:14749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785394023.203172:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394023.203224:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.203258:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422be40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394023.203867:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388032 00000100:00100000:0.0:1785394023.203873:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388032 00000100:00100000:0.0:1785394023.203906:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1785394023.203915:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831388032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785394023.204116:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831388032:12345-0@lo:502:mount.lustre.0 Request processed in 202us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.204124:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785394023.204131:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.204357:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1785394023.204496:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1785394023.204550:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1785394023.204670:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1785394023.204710:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1785394023.204760:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1785394023.204797:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1785394023.206076:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1785394023.206136:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1785394023.206176:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1785394023.206223:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1785394023.206269:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1785394023.206302:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1785394023.206331:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1785394023.206371:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1785394023.207698:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1785394023.207753:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1785394023.208337:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1785394023.208379:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1785394023.208905:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1785394023.208959:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1785394023.208995:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1785394023.209027:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1785394023.209083:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1785394023.209118:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1785394023.209144:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1785394023.209195:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1785394023.209233:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1785394023.209263:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1785394023.209311:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1785394023.209349:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1785394023.209383:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1785394023.210033:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1785394023.210101:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1785394023.210141:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1785394023.210189:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1785394023.210227:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1785394023.210266:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1785394023.210313:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1785394023.210347:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1785394023.212414:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394023.212491:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.212545:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422be40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.212614:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388160 00000100:00100000:1.0:1785394023.212622:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388160 00000100:00100000:1.0:1785394023.212669:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1785394023.212677:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831388160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394023.212889:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831388160:12345-0@lo:502:mount.lustre.0 Request processed in 213us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.212897:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785394023.213056:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394023.213140:0:14749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1785394023.213151:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1785394023.214045:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1785394023.214063:0:14773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93acce5d3380) 00000020:00000080:1.0:1785394023.214082:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1785394023.217666:0:14773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acc7a88800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785394023.217674:0:14773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acc7a88800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785394023.217677:0:14773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acc7a88800 3 00010000:00080000:1.0:1785394023.217712:0:14773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93abc1258800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1785394023.224111:0:14773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1785394023.224238:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1785394023.224274:0:14773:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785394023.224285:0:14773:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcc9b96d8b362ab5b 00000100:00080000:1.0:1785394023.224294:0:14773:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785394023.224300:0:14773:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93abc1258800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785394023.224336:0:14773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9633480 x1872120831388288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785394023.224362:0:14773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1785394023.224399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394023.224403:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785394023.225841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394023.225846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1785394023.227659:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831388416:0@lo:400:kworker.0 00000100:00100000:3.0:1785394023.227843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.227913:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831388288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1785394023.227943:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.227993:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388416 00000100:00100000:3.0:1785394023.228000:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388416 00000100:00100000:3.0:1785394023.228035:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388288 00000100:00100000:3.0:1785394023.228038:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388288 00000100:00100000:3.0:1785394023.228053:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785394023.228061:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831388416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394023.228110:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831388416:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394023.228116:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785394023.228132:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785394023.228136:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1872120831388288:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1785394023.228168:0:14115:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:3.0:1785394023.228205:0:14115:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcc9b96d8b362ab62 00000004:00100000:3.0:1785394023.228220:0:14115:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1785394023.228246:0:14115:0:(import.c:65:import_set_state_nolock()) ffff93acc7e2f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785394023.228284:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1872120831388288:12345-0@lo:38:llog_process_th.0 Request processed in 146us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394023.228291:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785394023.228325:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acf9630700 x1872120831388416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394023.228339:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831388416:0@lo:400:kworker.0 00010000:00080000:3.0:1785394023.228459:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93acf9633480 x1872120831388288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785394033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394023.228470:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785394023.228483:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1785394023.228490:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1785394023.228493:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1785394023.228496:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93abc1258800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1785394023.228501:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1872120831388288:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1785394023.229044:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1785394023.231630:0:14749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1785394023.231666:0:14749:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785394023.231685:0:14749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab4d expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.231711:0:14749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acff9f0200/0xcc9b96d8b362ab46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab4d expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785394023.231759:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785394023.231761:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785394023.231762:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394023.231764:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394023.231765:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394023.231766:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394023.231767:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394023.231769:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394023.231770:0:14749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785394023.231773:0:14749:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1785394023.231775:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785394023.231777:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785394023.231778:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394023.231779:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394023.231780:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394023.231781:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394023.231782:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394023.231783:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394023.231784:0:14749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785394023.231805:0:14749:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1785394023.231820:0:14749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785394023.231879:0:14749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394023.231900:0:14749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acec1bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.232145:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388544 00000100:00100000:1.0:1785394023.232151:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388544 00000100:00100000:1.0:1785394023.232184:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785394023.232190:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:14749:x1872120831388544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1785394023.232212:0:14108:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785394023.232224:0:14108:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1785394023.274996:0:14108:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1785394023.275014:0:14108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1785394023.275102:0:14131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1785394023.275107:0:14131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1785394023.275126:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.275144:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 16 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.275153:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.275188:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 16 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394023.275201:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 16 pid: 14110 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394023.275216:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831388672:0@lo:104: 00000100:00100000:2.0:1785394023.275275:0:14131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394023.275321:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1785394023.275548:0:14098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388672 00000100:00100000:1.0:1785394023.275564:0:14098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388672 00000100:00100000:1.0:1785394023.275626:0:14098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785394023.275633:0:14098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831388672:12345-0@lo:104: 00010000:00010000:1.0:1785394023.275644:0:14098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.275697:0:14098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785394023.275702:0:14098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831388672:12345-0@lo:104: Request processed in 70us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.275709:0:14098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1785394023.275729:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394023.275734:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.275741:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba200 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785394023.275746:0:14103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.275754:0:14103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785394023.275761:0:14103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394023.275767:0:14103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1785394023.275793:0:14103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.275800:0:14103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1785394023.275848:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831388672:0@lo:104: 00010000:00010000:3.0:1785394023.275867:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276631:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394023.276642:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831388800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394023.276647:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acc82ba200/0xcc9b96d8b362aacf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aad6 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276661:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394023.276663:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394023.276665:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785394023.276673:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394023.276696:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388800 00000100:00100000:1.0:1785394023.276700:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388800 00010000:00010000:1.0:1785394023.276716:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 17 pid: 14110 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394023.276735:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785394023.276741:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+17:3316:x1872120831388800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394023.276750:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394023.276755:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 17 pid: 14110 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276765:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 17 pid: 14110 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276777:0:14100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1200/0xcc9b96d8b362aad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362aacf expref: 17 pid: 14110 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276788:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.276796:0:14100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785394023.278630:0:14100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003522955s 00010000:00010000:1.0:1785394023.278635:0:14100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278641:0:14100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278647:0:14100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278652:0:14100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278657:0:14100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394023.278660:0:14100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278666:0:14100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278685:0:14100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394023.278694:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394023.278740:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:daecb8d0-f73c-4aec-8915-f89616659996+16:3316:x1872120831388800:12345-0@lo:103:ldlm_bl.0 Request processed in 1998us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394023.278748:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1785394023.279948:0:14131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.279960:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394023.279967:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0c00/0xcc9b96d8b362ab69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394023.280673:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831388800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785394023.321476:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+15:14749:x1872120831388544:12345-0@lo:253:mount.lustre.0 Request processed in 89277us (89588us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394023.321490:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785394023.321653:0:14749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:14749:1872120831388544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785394023.321667:0:14749:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1785394023.321670:0:14749:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785394023.321672:0:14749:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785394023.321673:0:14749:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394023.321675:0:14749:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394023.321676:0:14749:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394023.321677:0:14749:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394023.321679:0:14749:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394023.321681:0:14749:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394023.321682:0:14749:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1785394023.321705:0:14749:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1785394023.332283:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1785394023.335886:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1785394023.336088:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1785394023.336243:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1785394023.336383:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1785394023.336637:0:14749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1785394023.343080:0:14749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1785394023.392594:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1785394023.650565:0:14749:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1785394023.650747:0:14749:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1785394023.650904:0:14749:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1785394023.651075:0:14749:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1785394023.651113:0:14749:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1785394023.651159:0:14749:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1785394024.422913:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785394024.936886:0:14112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785394024.936893:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93abc19f3000 from 7 10000000:01000000:2.0:1785394024.936898:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785394024.936939:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394024.936951:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394024.936968:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394024.936993:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831388928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785394024.937056:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394024.937104:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785394024.937152:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831388928 00000100:00100000:1.0:1785394024.937159:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831388928 00000100:00100000:1.0:1785394024.940667:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785394024.940682:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+15:14112:x1872120831388928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785394024.940700:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394024.940717:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ab70 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394024.940742:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 16 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394024.940752:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 16 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394024.940762:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acc82ba200, rc 0) 00000100:00100000:1.0:1785394024.940829:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:14112:x1872120831388928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (3772us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394024.940837:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785394024.945115:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831388928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785394024.945140:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394024.945151:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394024.945215:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831389056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1785394024.945270:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394024.954471:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389056 00000100:00100000:1.0:1785394024.954481:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389056 00000100:00100000:1.0:1785394024.954540:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785394024.954550:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:14112:x1872120831389056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1785394024.954589:0:14110:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785394024.954604:0:14110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785394024.954607:0:14110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1785394024.954710:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:14112:x1872120831389056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (9439us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394024.954725:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785394024.955633:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf890dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785394024.955659:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831389056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1785394024.955721:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785394024.955730:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394024.955741:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394025.439719:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394026.467517:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785394027.362602:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785394027.488080:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394028.515731:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785394028.589617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785394028.589623:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1785394028.589626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785394028.589629:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1785394028.589680:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831389184:0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.589736:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394028.589780:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785394028.589785:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831389312:0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.589805:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394028.589832:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831389440:0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.589852:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394028.589879:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389184 00000100:00100000:0.0:1785394028.589885:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389184 00000100:00100000:0.0:1785394028.589918:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785394028.589926:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:3317:x1872120831389184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.589965:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:3317:x1872120831389184:12345-0@lo:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394028.589971:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785394028.589998:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389312 00000100:00100000:0.0:1785394028.590001:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389312 00000100:00100000:0.0:1785394028.590020:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389440 00000100:00100000:0.0:1785394028.590022:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389440 00000100:00100000:0.0:1785394028.590046:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785394028.590051:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831389312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.590086:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831389312:12345-0@lo:400:kworker.0 Request processed in 35us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394028.590092:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785394028.590101:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394028.590106:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831389440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.590128:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831389440:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394028.590132:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785394028.590168:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad003c9180 x1872120831389440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785394028.590182:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831389440:0@lo:400:kworker.0 00010000:00080000:0.0:1785394028.590203:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ad003c8700 x1872120831389312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785394028.590212:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831389312:0@lo:400:kworker.0 00000100:00100000:0.0:1785394028.590220:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831389184:0@lo:400:kworker.0 00000100:00080000:1.0:1785394028.591698:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785394029.538587:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394030.370755:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785394015/real 1785394015] req@ffff93acf9631c00 x1872120831384704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394030.370794:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93acf9631c00 x1872120831384704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394030.370805:0:3314:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785394015/real 1785394015] req@ffff93acf9632680 x1872120831384832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394030.370815:0:3314:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93acf9632680 x1872120831384832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785394030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785394030.370833:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf791b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785394030.370848:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1785394030.370852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831384704:0@lo:8:kworker.0 00000100:00080000:2.0:1785394030.370857:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785394030.370862:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1785394030.370865:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831384832:0@lo:8:kworker.0 00000100:00080000:3.0:1785394030.372696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394030.372713:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1785394030.372716:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf791b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785394030.372723:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:3.0:1785394030.372728:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1785394030.372734:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93acf791b800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394030.372754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d72300 x1872120831389696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785394030.372769:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394030.372772:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785394030.372774:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785394030.372777:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:3.0:1785394030.372780:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1785394030.372783:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394030.372791:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d71f80 x1872120831389824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785394030.372830:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394030.372842:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831389568:0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.372902:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394030.372946:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831389952:0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.372970:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394030.372987:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394030.372991:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831390080:0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.373009:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394030.373034:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389568 00000100:00100000:3.0:1785394030.373040:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389568 00000100:00100000:3.0:1785394030.373083:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785394030.373090:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:3315:x1872120831389568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.374711:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:3315:x1872120831389568:12345-0@lo:400:kworker.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394030.374726:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785394030.374771:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389952 00000100:00100000:3.0:1785394030.374775:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389952 00000100:00100000:3.0:1785394030.374804:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390080 00000100:00100000:3.0:1785394030.374806:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390080 00000100:00100000:3.0:1785394030.374827:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785394030.374834:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831389952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.374879:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831389952:12345-0@lo:400:kworker.0 Request processed in 45us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394030.374885:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785394030.374896:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785394030.374902:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831390080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.374925:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831390080:12345-0@lo:400:kworker.0 Request processed in 23us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394030.374930:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1785394030.374952:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785394030.374976:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d72d80 x1872120831390080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394030.374990:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831390080:0@lo:400:kworker.0 00010000:00080000:3.0:1785394030.374999:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d72a00 x1872120831389952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394030.375008:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831389952:0@lo:400:kworker.0 00000100:00100000:3.0:1785394030.375045:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831389568:0@lo:400:kworker.0 00000100:00100000:2.0:1785394030.376765:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831389696:0@lo:8:kworker.0 00000100:00100000:2.0:1785394030.376826:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394030.376875:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831389824:0@lo:8:kworker.0 00000100:00100000:2.0:1785394030.376896:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394030.376935:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389696 00000100:00100000:2.0:1785394030.376941:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389696 00000100:00100000:2.0:1785394030.376963:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831389824 00000100:00100000:2.0:1785394030.376966:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831389824 00000100:00100000:2.0:1785394030.376979:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785394030.376985:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831389696:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1785394030.377010:0:14752:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1785394030.377046:0:14752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362ab7e 00002000:00100000:2.0:1785394030.377058:0:14752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93acec19a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1785394030.377062:0:14752:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1785394030.377064:0:14752:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1785394030.377380:0:14752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785394030.377404:0:14752:0:(import.c:65:import_set_state_nolock()) ffff93acec199000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785394030.377447:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1872120831389696:12345-0@lo:8:kworker.0 Request processed in 461us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394030.377454:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785394030.377467:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785394030.377472:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831389824:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1785394030.377482:0:14752:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1785394030.377516:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831389824:12345-0@lo:8:kworker.0 Request processed in 42us (618us total) trans 0 rc -19/-19 00000100:00100000:2.0:1785394030.377522:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785394030.377558:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d72300 x1872120831389696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785394050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394030.377584:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785394030.377591:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1785394030.377599:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1785394030.377604:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1785394030.377606:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf791b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1785394030.377618:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1785394030.377624:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831389696:0@lo:8:kworker.0 00000100:00080000:2.0:1785394030.377635:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785394030.377638:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1785394030.378386:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831389824:0@lo:8:kworker.0 00000004:00080000:2.0:1785394030.378442:0:14138:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1785394030.378460:0:14138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14138:1872120831390336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1785394030.378499:0:14138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394030.378517:0:14138:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee240 going to sleep for 11 seconds 00000004:00080000:2.0:1785394030.378532:0:14137:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1785394030.379693:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785394030.379706:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831390208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785394030.379740:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1785394030.379748:0:14137:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562411177779ns, next at 0ns, rc = 0 00000100:00100000:2.0:1785394030.379806:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390336 00000100:00100000:2.0:1785394030.379812:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390336 00000100:00100000:1.0:1785394030.379826:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390208 00000100:00100000:1.0:1785394030.379830:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390208 00000100:00100000:2.0:1785394030.379850:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785394030.379855:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785394030.379857:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14138:x1872120831390336:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1785394030.379860:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1872120831390208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785394030.379880:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785394030.379918:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1872120831390208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394030.379925:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1785394030.380257:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785394030.380270:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d58700 x1872120831390208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785394046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394030.380287:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831390208:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1785394030.393112:0:14752:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1785394030.393122:0:14752:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1785394030.393127:0:14752:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1785394030.424352:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.424364:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.424380:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.424384:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.424390:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.424406:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.424427:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.424435:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.425283:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785394030.426894:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.426905:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.426920:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.426924:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.426930:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.426943:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.426952:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.426960:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.426987:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785394030.428287:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785394030.428295:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428304:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394030.428307:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428316:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428334:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428340:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ff7788d/0xcc9b96d8b362ab85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428367:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785394030.428377:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428383:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394030.428385:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428392:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428399:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428405:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014233a5/0xcc9b96d8b362ab8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.428414:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394030.428416:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394030.428417:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.429782:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.430999:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.431009:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.431025:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.431029:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.431036:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.431049:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.431059:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.431068:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.431094:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.431515:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.431522:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.431531:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.431535:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.431555:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.431590:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.431598:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad9a3712/0xcc9b96d8b362ab93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.431617:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.431619:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.431620:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.433081:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.433088:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.433100:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.433108:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.433114:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.433125:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.433147:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.433155:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.433175:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785394030.435518:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785394030.435529:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.435541:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394030.435546:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.435584:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.435605:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.435613:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ddd449/0xcc9b96d8b362ab9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394030.435634:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394030.435636:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394030.435638:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.445862:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.445875:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445891:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.445896:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.445902:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445917:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445928:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445943:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445963:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.445978:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.445983:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.445991:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.445996:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.446005:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.446023:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.446031:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005192d2e/0xcc9b96d8b362aba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.446051:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.446053:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.446055:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.448127:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.448740:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448753:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.448757:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.448763:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448777:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448786:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448794:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448812:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.448823:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.448828:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448835:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.448838:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448846:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448865:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448872:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362aba8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.448887:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.448889:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.448890:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.451421:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.451431:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451444:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.451448:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.451454:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451622:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451633:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451641:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451862:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.451874:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.451880:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451889:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.451894:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451903:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451919:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451926:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237e92a7/0xcc9b96d8b362abaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.451942:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.451944:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.451945:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.452988:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.452994:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453003:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.453010:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.453015:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453024:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453031:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453037:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453048:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.453056:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.453060:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453065:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.453068:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453075:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453085:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453102:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a51b185a/0xcc9b96d8b362abb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.453115:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.453117:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.453119:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394030.454860:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394030.454868:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454878:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1785394030.454882:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394030.454887:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454896:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454904:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454912:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454925:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.454934:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.454944:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454950:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.454954:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454963:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454975:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454981:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362abbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.454995:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.454996:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.454998:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.462238:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.462249:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.462265:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.462269:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.462276:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.462290:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.462300:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.462313:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.462343:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.462520:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.462528:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.462536:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.462540:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.462549:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.462565:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.462608:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000758d348d/0xcc9b96d8b362abc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.462625:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.462627:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.462629:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.463146:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.463152:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.463162:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.463165:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.463169:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.463178:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.463185:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.463191:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.463206:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785394030.467042:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.467054:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.467076:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.467080:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.467087:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.467101:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.467112:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.467120:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.468209:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785394030.468997:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785394030.469006:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469016:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.469021:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469040:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469056:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469063:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cdc29b/0xcc9b96d8b362abcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469078:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.469082:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469088:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bba00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.469092:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469100:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469108:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.469115:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ab68b8/0xcc9b96d8b362abd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.470748:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.470753:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.470755:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.470800:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.470808:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.470820:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.470824:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.470830:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.470842:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.470859:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.470866:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.471182:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.471392:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.471397:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.471405:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82baa00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.471409:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.471416:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.471429:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.471435:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e93abab1/0xcc9b96d8b362abd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.471447:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.471449:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.471450:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.472083:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.472090:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.472098:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.472102:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.472106:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.472116:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.472124:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.473212:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.473253:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394030.473644:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394030.473651:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.473791:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394030.473796:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.473805:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.473822:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.473829:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000395b1690/0xcc9b96d8b362abe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394030.473851:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.473852:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394030.473854:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.473999:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.475482:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.475499:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.476304:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.476309:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.476367:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.476383:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.476394:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.476402:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.476426:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.476545:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.476552:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.476561:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbe00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.476565:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.476589:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.476606:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.476614:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fd7890/0xcc9b96d8b362abe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.476633:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.476635:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.476655:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.478102:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.478110:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.478121:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.478130:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.479276:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.479288:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.479296:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.479303:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.479610:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785394030.481695:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.481703:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.481715:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.481719:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.481724:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.481735:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.481742:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481751:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394030.481756:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481758:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481767:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bac00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394030.481771:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.481771:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481779:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481795:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481802:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124137ab/0xcc9b96d8b362abee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481821:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.481825:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481831:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82ba000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.481834:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481841:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481857:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481863:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605d904f/0xcc9b96d8b362abf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.481876:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.481878:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.481880:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.481887:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.482138:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.482144:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.482152:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.482155:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.482159:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.482168:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.482176:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.482183:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.482195:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.482330:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.482335:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.482343:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bb400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.482346:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.482354:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.482364:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.482371:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa509f2/0xcc9b96d8b362abfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.482392:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.482394:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.482395:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.486736:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.486748:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.486771:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.486774:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.486780:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.486792:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.486800:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.486807:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.486827:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785394030.487314:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.487372:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.487380:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.487382:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.487386:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.487395:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.487411:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.487417:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.487428:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785394030.488892:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785394030.488903:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488915:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc82bbc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.488920:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488932:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488950:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488959:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd81115/0xcc9b96d8b362ac03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488977:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.488981:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.488988:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.488998:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.489007:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.489017:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.489025:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002329c489/0xcc9b96d8b362ac0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.489037:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.489039:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.489041:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.489047:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.493689:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.493703:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.493722:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.493726:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.493731:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.493744:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.493752:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.493759:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.493797:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.493991:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.493999:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.494010:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.494014:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.494025:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.494041:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.494056:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036a4f04b/0xcc9b96d8b362ac11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.494077:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.494080:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.494082:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.495853:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.495861:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.495872:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.495875:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.495880:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.495889:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.495896:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.495903:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.495922:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.496037:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.496043:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.496052:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.496056:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.496064:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.496077:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.496083:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002126e2f4/0xcc9b96d8b362ac18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.496096:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.496098:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.496100:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785394030.497215:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1785394030.497663:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.497669:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.497682:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.497692:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.497699:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.497711:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.497721:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.497730:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.497751:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.497786:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.497793:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.497801:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.497805:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.497813:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.497827:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.497834:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d20ce14/0xcc9b96d8b362ac1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.497851:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.497854:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.497857:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.498250:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.498256:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498264:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.498267:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.498271:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498280:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498288:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498301:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498323:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.498410:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.498416:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498426:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0030600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.498429:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498451:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498474:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498483:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012957ff6/0xcc9b96d8b362ac26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498516:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.498519:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.498521:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.498724:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.498731:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498738:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.498741:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.498745:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498754:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498762:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498768:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.498787:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.498933:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.498938:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498945:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acc0031600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.498950:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498958:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498968:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498984:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43a110e/0xcc9b96d8b362ac2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.498997:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.498999:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.499000:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.499214:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.499220:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499232:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.499234:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.499238:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499247:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499255:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499262:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499282:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.499385:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.499391:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499399:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.499403:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499413:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499426:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499434:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb7e2df/0xcc9b96d8b362ac34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499450:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.499452:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.499453:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785394030.499680:0:14752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394030.499686:0:14752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499694:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1785394030.499697:0:14752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394030.499700:0:14752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499709:0:14752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499727:0:14752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499735:0:14752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394030.499752:0:14752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394030.499794:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394030.499800:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499807:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394030.499811:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499818:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499830:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499837:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06b7eba/0xcc9b96d8b362ac3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394030.499857:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.499861:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394030.499864:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1785394030.499925:0:14752:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1785394030.500035:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14138:x1872120831390336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120175us (121532us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394030.500048:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785394030.500193:0:14138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14138:1872120831390336:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1785394030.500208:0:14138:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1785394030.500252:0:14138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14138:1872120831390464:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1785394030.500288:0:14138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394030.500349:0:14138:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace422b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785394030.500656:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390464 00000100:00100000:1.0:1785394030.500663:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390464 00000100:00100000:1.0:1785394030.500705:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785394030.500714:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14138:x1872120831390464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1785394030.500748:0:14751:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1785394030.511220:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14138:x1872120831390464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10501us (10926us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1785394030.511231:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785394030.511280:0:14138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14138:1872120831390464:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1785394030.511293:0:14138:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1785394030.576389:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394031.586950:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394032.611166:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785394032.622759:0:15118:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785394033.631786:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785394033.953425:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1785394033.954126:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1785394034.656817:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394035.680004:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785394035.745492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394035.745499:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785394035.745502:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785394035.745510:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1785394035.745515:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1785394035.745522:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785394035.745559:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9631880 x1872120831390848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785394035.745642:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831390848:0@lo:8:kworker.0 00000100:00100000:1.0:1785394035.745707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394035.745769:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390848 00000100:00100000:1.0:1785394035.745776:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390848 00000100:00100000:1.0:1785394035.745807:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785394035.745813:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831390848:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1785394035.745832:0:14752:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1785394035.749125:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831390592:0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749187:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394035.749225:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785394035.749233:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831391104:0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749272:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394035.749302:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831390720:0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749337:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394035.749355:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394035.749361:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831390976:0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394035.749416:0:14753:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1785394035.749425:0:14753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1785394035.749441:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391104 00000100:00100000:3.0:1785394035.749447:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391104 00000100:00100000:3.0:1785394035.749498:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390976 00000100:00100000:3.0:1785394035.749501:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390976 00000100:00100000:3.0:1785394035.749514:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785394035.749522:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831391104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749566:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831391104:12345-0@lo:400:kworker.0 Request processed in 45us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394035.749587:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785394035.749602:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785394035.749608:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831390976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749646:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831390976:12345-0@lo:400:kworker.0 Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394035.749653:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1785394035.749751:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf9631c00 x1872120831391104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394035.749764:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831391104:0@lo:400:kworker.0 00010000:00080000:3.0:1785394035.749787:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf9632680 x1872120831390976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394035.749803:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831390976:0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.749850:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390720 00000100:00100000:3.0:1785394035.749853:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390720 00000100:00100000:3.0:1785394035.749873:0:14753:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1785394035.749880:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785394035.749886:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831390720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394035.750124:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831390720:12345-0@lo:400:kworker.0 Request processed in 237us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394035.750131:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785394035.750157:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1785394035.750167:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831390720:0@lo:400:kworker.0 00000100:00080000:2.0:1785394035.750364:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785394035.750375:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785394035.750386:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831391232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785394035.750415:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394035.750694:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831390592 00000100:00100000:0.0:1785394035.750699:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831390592 00000100:00100000:0.0:1785394035.750798:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785394035.750805:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:3316:x1872120831390592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394035.750843:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:3316:x1872120831390592:12345-0@lo:400:kworker.0 Request processed in 38us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394035.750861:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785394035.752197:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831390592:0@lo:400:kworker.0 00000100:00100000:2.0:1785394035.757430:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391232 00000100:00100000:2.0:1785394035.757442:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391232 00000100:00100000:2.0:1785394035.757501:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785394035.757511:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831391232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785394035.757545:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785394035.760075:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831391232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2560us (9653us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394035.760087:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785394035.760157:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831391232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785394035.797331:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831390848:12345-0@lo:8:kworker.0 Request processed in 51508us (51615us total) trans 0 rc -19/-19 00000100:00100000:1.0:1785394035.797344:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1785394035.797394:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785394035.797399:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1785394035.797403:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831390848:0@lo:8:kworker.0 00010000:00010000:3.0:1785394036.708047:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785394037.601076:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785394037.728792:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394038.754820:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394039.775743:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394040.803864:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785394040.863725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785394040.863734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785394040.863738:0:37:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785394040.863748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00080000:1.0:1785394040.863753:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1785394040.863761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1785394040.863786:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf9630700 x1872120831391616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785394040.863867:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831391360:0@lo:400:kworker.0 00000100:00100000:1.0:1785394040.863953:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394040.864019:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785394040.864026:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831391488:0@lo:400:kworker.0 00000100:00100000:1.0:1785394040.864182:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394040.864242:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831392000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785394040.864278:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394040.864318:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831391616:0@lo:8:kworker.0 00000100:00100000:1.0:1785394040.864342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394040.864737:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831391744:0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.864787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394040.864810:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785394040.864815:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831391872:0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.864838:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394040.867352:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392000 00000100:00100000:2.0:1785394040.867367:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392000 00000100:00100000:2.0:1785394040.867448:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785394040.867459:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831392000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785394040.869001:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785394040.869080:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831392000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1622us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394040.869088:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785394040.869952:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391744 00000100:00100000:2.0:1785394040.869959:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391744 00000100:00100000:2.0:1785394040.869994:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391872 00000100:00100000:2.0:1785394040.869997:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391872 00000100:00100000:2.0:1785394040.870017:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785394040.870023:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831391744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.870068:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831391744:12345-0@lo:400:kworker.0 Request processed in 45us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394040.870075:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785394040.870086:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785394040.870091:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831391872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.870116:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831391872:12345-0@lo:400:kworker.0 Request processed in 25us (5277us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394040.870121:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1785394040.870239:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785394040.870244:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785394040.870295:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf9633b80 x1872120831391872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394040.870311:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831391872:0@lo:400:kworker.0 00010000:00080000:2.0:1785394040.870322:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf9632a00 x1872120831391744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394040.870330:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831391744:0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.870375:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831392000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785394040.871801:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391360 00000100:00100000:1.0:1785394040.871809:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391360 00000100:00100000:1.0:1785394040.871849:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785394040.871857:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:3317:x1872120831391360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394040.871905:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+16:3317:x1872120831391360:12345-0@lo:400:kworker.0 Request processed in 49us (7952us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394040.871912:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1785394040.872111:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391488 00000100:00100000:0.0:1785394040.872116:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391488 00000100:00100000:0.0:1785394040.872218:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831391616 00000100:00100000:0.0:1785394040.872222:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831391616 00000100:00100000:0.0:1785394040.872236:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394040.872243:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831391488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394040.872383:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831391488:12345-0@lo:400:kworker.0 Request processed in 140us (8200us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394040.872390:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394040.872404:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785394040.872408:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1872120831391616:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1785394040.872436:0:14753:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1785394040.873675:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831391488:0@lo:400:kworker.0 00000100:00100000:2.0:1785394040.873692:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:daecb8d0-f73c-4aec-8915-f89616659996:3317:1872120831391360:0@lo:400:kworker.0 00000100:00100000:0.0:1785394040.904909:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3314:x1872120831391616:12345-0@lo:8:kworker.0 Request processed in 32487us (40553us total) trans 0 rc -19/-19 00000100:00100000:0.0:1785394040.904928:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1785394040.905469:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785394040.905475:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1785394040.905480:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831391616:0@lo:8:kworker.0 00010000:00010000:2.0:1785394041.827111:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785394042.103454:0:15422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785394042.103459:0:15422:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1785394042.103626:0:15422:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93acce59a000 00000020:01000004:3.0:1785394042.103645:0:15422:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1785394042.103660:0:15422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1785394042.103678:0:15422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93acc95399c0) 00000020:00000080:3.0:1785394042.103696:0:15422:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785394042.157976:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785394042.160507:0:15422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785394042.161985:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785394042.164498:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1785394042.164789:0:15422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1785394042.166715:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 541: rc = 0 00100000:10000000:3.0:1785394042.166808:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 541: rc = 0 00100000:10000000:3.0:1785394042.166908:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 541: rc = 0 00100000:10000000:3.0:1785394042.170178:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 543: rc = 0 00100000:10000000:3.0:1785394042.170768:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 543: rc = 0 00100000:10000000:3.0:1785394042.171621:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 543: rc = 0 00100000:10000000:3.0:1785394042.173196:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 543: rc = 0 00100000:10000000:3.0:1785394042.173969:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 543: rc = 0 00100000:10000000:3.0:1785394042.175540:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 543: rc = 0 00000020:00000080:3.0:1785394042.177222:0:15422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785394042.177238:0:15422:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785394042.177433:0:15422:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc9b96d8b362ac49 00000020:01000004:3.0:1785394042.177446:0:15422:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785394042.177473:0:15422:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785394042.177476:0:15422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785394042.177484:0:15422:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785394042.177512:0:15422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785394042.177517:0:15422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1785394042.201800:0:15422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785394042.202072:0:15422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1785394042.202171:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785394042.202174:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785394042.202175:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785394042.202176:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785394042.202185:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785394042.202187:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785394042.202188:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785394042.202190:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785394042.202192:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785394042.202196:0:15422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1785394042.202199:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785394042.202200:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785394042.202201:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785394042.202202:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785394042.202203:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785394042.202204:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785394042.202204:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785394042.202205:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785394042.202206:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785394042.202421:0:15422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1785394042.202447:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785394042.202540:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.202675:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc88d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394042.210526:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392128 00000100:00100000:0.0:1785394042.210545:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392128 00000100:00100000:1.0:1785394042.210801:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785394042.210813:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:15422:x1872120831392128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1785394042.210861:0:14108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1785394042.210865:0:14108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1785394042.210870:0:14108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1785394042.261822:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:15422:x1872120831392128:12345-0@lo:253:mount.lustre.0 Request processed in 50997us (59266us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394042.261842:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785394042.262076:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785394042.262096:0:15422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1785394042.262100:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785394042.262102:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785394042.262103:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394042.262104:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394042.262106:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394042.262107:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394042.262109:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394042.262111:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394042.262113:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785394042.262141:0:15422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93acce59a000 from lustre-OST0001 10000000:01000000:3.0:1785394042.262182:0:15422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1785394042.262186:0:15422:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1785394042.262196:0:15422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93acf96619c0 local copy 00010000:00010000:3.0:1785394042.262209:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394042.262701:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394042.262751:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.262798:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785394042.262866:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392256 00000100:00100000:0.0:1785394042.262874:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392256 00000100:00100000:0.0:1785394042.262921:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785394042.262931:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:15422:x1872120831392256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785394042.263221:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:15422:x1872120831392256:12345-0@lo:501:mount.lustre.0 Request processed in 290us (468us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785394042.263248:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785394042.263998:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785394042.264016:0:15422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785394042.265449:0:15422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785394042.265462:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.265488:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93acd7c59200/0xcc9b96d8b362a9f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362a9fd expref: -99 pid: 14097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394042.265517:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93acce59a000 10000000:01000000:1.0:1785394042.265522:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785394042.265528:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1785394042.265530:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785394042.265536:0:15422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1785394042.265539:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1785394042.265606:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.265616:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.265628:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394042.265650:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785394042.265705:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.265753:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd8caed80 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.267445:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392384 00000100:00100000:3.0:1785394042.267459:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392384 00000100:00100000:3.0:1785394042.267521:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785394042.267531:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:15422:x1872120831392384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785394042.267550:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394042.267567:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0400/0xcc9b96d8b362ac57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ac50 expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.267632:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0400/0xcc9b96d8b362ac57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac50 expref: 17 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.267645:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0400/0xcc9b96d8b362ac57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac50 expref: 17 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.267655:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0400, rc 0) 00000100:00100000:3.0:1785394042.267715:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392384:12345-0@lo:101:mount.lustre.0 Request processed in 186us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.267722:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785394042.267838:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394042.267859:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac57 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.267870:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ac57 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785394042.280498:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1785394042.284102:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394042.284392:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1785394042.284464:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1785394042.284501:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1785394042.284551:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1785394042.284604:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1785394042.284635:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1785394042.284692:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1785394042.284699:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1785394042.284794:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394042.284875:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.287518:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd824bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.292934:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392512 00000100:00100000:3.0:1785394042.292952:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392512 00000100:00100000:3.0:1785394042.293030:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785394042.293043:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394042.294486:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392512:12345-0@lo:501:mount.lustre.0 Request processed in 1444us (9607us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.294498:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785394042.294642:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394042.294707:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394042.294763:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.294796:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd824bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1785394042.294857:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392640 00000100:00100000:0.0:1785394042.294863:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392640 00000100:00100000:0.0:1785394042.294898:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785394042.294906:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785394042.295479:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392640:12345-0@lo:503:mount.lustre.0 Request processed in 573us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394042.295487:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785394042.295563:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785394042.296444:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785394042.296514:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394042.296548:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.296592:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf70093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785394042.296790:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392768 00000100:00100000:1.0:1785394042.296795:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392768 00000100:00100000:1.0:1785394042.296828:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785394042.296844:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394042.297019:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392768:12345-0@lo:502:mount.lustre.0 Request processed in 175us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394042.297026:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785394042.297078:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785394042.297483:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1785394042.297528:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1785394042.297558:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1785394042.297625:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1785394042.297656:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1785394042.297685:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1785394042.297726:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1785394042.297755:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1785394042.297803:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1785394042.297828:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394042.298649:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.298715:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf70093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.298754:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831392896 00000100:00100000:3.0:1785394042.298765:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831392896 00000100:00100000:3.0:1785394042.298829:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785394042.298889:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785394042.299097:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831392896:12345-0@lo:502:mount.lustre.0 Request processed in 209us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.299105:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1785394042.299170:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9631f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831392896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785394042.299260:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1785394042.299272:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1785394042.300492:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785394042.300503:0:15423:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1785394042.300512:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.300515:0:15423:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1785394042.300521:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785394042.300539:0:15423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93acc85a19c0) 00000020:00000080:0.0:1785394042.300564:0:15423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785394042.300599:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785394042.300668:0:15423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acce59a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1785394042.300679:0:15423:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785394042.300687:0:15423:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcc9b96d8b362ac65 00010000:00010000:0.0:1785394042.310188:0:15423:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1785394042.310971:0:15423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1785394042.314388:0:15423:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1785394042.316197:0:15423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1785394042.316211:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785394042.316220:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.316222:0:15423:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1785394042.316226:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785394042.316230:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.316232:0:15423:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785394042.316341:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785394042.316344:0:15423:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785394042.316346:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785394042.316349:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.316350:0:15423:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785394042.316371:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785394042.316375:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.316377:0:15423:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785394042.316381:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1785394042.316524:0:15423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785394042.316528:0:15423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785394042.316529:0:15423:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785394042.316533:0:15423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1785394042.316714:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1785394042.316745:0:15422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1785394042.316772:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac57 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394042.316786:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93abc31b2600/0xcc9b96d8b362ac50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac57 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785394042.316794:0:15422:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acce59a000 from 1 10000000:01000000:2.0:1785394042.316798:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785394042.316896:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394042.316906:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394042.316919:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394042.316949:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785394042.317037:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.317221:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf70093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785394042.320684:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393024 00000100:00100000:0.0:1785394042.320698:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393024 00000100:00100000:0.0:1785394042.320804:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785394042.320817:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:15422:x1872120831393024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785394042.320849:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394042.320873:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ac6c expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.320905:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.320919:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.320930:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59400, rc 0) 00000100:00100000:0.0:1785394042.321032:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393024:12345-0@lo:101:mount.lustre.0 Request processed in 217us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394042.321039:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785394042.323200:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785394042.323227:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394042.323279:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785394042.323928:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1785394042.324664:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785394042.325093:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1785394042.325144:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1785394042.325202:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1785394042.325209:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1785394042.325286:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394042.325359:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.329038:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf70093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.333897:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393152 00000100:00100000:3.0:1785394042.333914:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393152 00000100:00100000:3.0:1785394042.333977:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1785394042.333989:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394042.334395:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393152:12345-0@lo:501:mount.lustre.0 Request processed in 408us (9035us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.334404:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785394042.334700:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785394042.334801:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785394042.334887:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.334970:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf70093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785394042.334986:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393280 00000100:00100000:2.0:1785394042.334990:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393280 00000100:00100000:0.0:1785394042.339470:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785394042.339514:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393280:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785394042.342877:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393280:12345-0@lo:503:mount.lustre.0 Request processed in 3384us (7981us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394042.342892:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785394042.343358:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785394042.346428:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785394042.346543:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394042.346726:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394042.347138:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ad006b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.355498:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393408 00000100:00100000:3.0:1785394042.355518:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393408 00000100:00100000:3.0:1785394042.355641:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785394042.355654:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394042.356338:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785394042.356751:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1785394042.356855:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1785394042.356970:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1785394042.357011:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1785394042.357059:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1785394042.357112:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1785394042.357145:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1785394042.357173:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1785394042.357215:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394042.359231:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.359337:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd0525e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785394042.359690:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393536 00000100:00100000:2.0:1785394042.359699:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393536 00000100:00100000:2.0:1785394042.359793:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785394042.359815:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394042.361185:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393536:12345-0@lo:502:mount.lustre.0 Request processed in 1355us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394042.361209:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785394042.361528:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785394042.361731:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1785394042.361749:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:3.0:1785394042.363214:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393408:12345-0@lo:502:mount.lustre.0 Request processed in 7560us (16484us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.363251:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:01000000:1.0:1785394042.363838:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394042.363850:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.363852:0:15427:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1785394042.363861:0:15427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acce59a000 00000020:00000080:1.0:1785394042.363863:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394042.363870:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394042.363872:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.363874:0:15427:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1785394042.363876:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394042.363878:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.363880:0:15427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785394042.363883:0:15427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93acce59a000 00000020:00000080:1.0:1785394042.363885:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394042.363950:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394042.363954:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.363955:0:15427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1785394042.363958:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785394042.363960:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.363961:0:15427:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785394042.363964:0:15427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93acce59a000 00000020:00000080:1.0:1785394042.363973:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785394042.364011:0:15427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785394042.364015:0:15427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785394042.364016:0:15427:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785394042.364019:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1785394042.365345:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1785394042.365377:0:15422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785394042.365401:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.365425:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394042.365493:0:15422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785394042.365497:0:15422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93acce59a000 10000000:01000000:1.0:1785394042.365500:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93acce59a000 10000000:01000000:1.0:1785394042.365504:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785394042.365510:0:15422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93acce59a000 from 1 10000000:01000000:1.0:1785394042.365513:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785394042.365555:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.365564:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.365592:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394042.365616:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785394042.365684:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.365724:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93000 going to sleep for 11 seconds 00000100:00100000:1.0:1785394042.370200:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393664 00000100:00100000:1.0:1785394042.370221:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393664 00000100:00100000:1.0:1785394042.370352:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785394042.370371:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc13fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831393664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394042.370404:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394042.370443:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93abc31b3600/0xcc9b96d8b362ac81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ac7a expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.370485:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93abc31b3600/0xcc9b96d8b362ac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac7a expref: 19 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.370498:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93abc31b3600/0xcc9b96d8b362ac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac7a expref: 19 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.370509:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3600, rc 0) 00000100:00100000:1.0:1785394042.370614:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc13fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393664:12345-0@lo:101:mount.lustre.0 Request processed in 246us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394042.370622:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785394042.370688:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785394042.370709:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac81 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394042.370719:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ac81 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785394042.371528:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1785394042.371940:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785394042.372238:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1785394042.372292:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1785394042.372386:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1785394042.372479:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1785394042.372538:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1785394042.372610:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1785394042.372643:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1785394042.372671:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1785394042.372711:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1785394042.372740:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1785394042.372767:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1785394042.372806:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1785394042.372837:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1785394042.372865:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1785394042.372902:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1785394042.372937:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1785394042.372970:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1785394042.373031:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1785394042.373068:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1785394042.373100:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1785394042.373149:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1785394042.373187:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1785394042.373222:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1785394042.373261:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1785394042.373289:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1785394042.373323:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1785394042.373388:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1785394042.377539:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1785394042.377739:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1785394042.377814:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1785394042.378680:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1785394042.378719:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1785394042.378748:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1785394042.378829:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1785394042.378889:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1785394042.378950:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1785394042.378981:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1785394042.379637:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1785394042.379646:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1785394042.379774:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785394042.379849:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.379893:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93000 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.380133:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393792 00000100:00100000:3.0:1785394042.380142:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393792 00000100:00100000:3.0:1785394042.380220:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785394042.380231:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc13f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785394042.380565:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc13f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393792:12345-0@lo:501:mount.lustre.0 Request processed in 336us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.380607:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785394042.382362:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785394042.383131:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785394042.383227:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.384146:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9a93000 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.385171:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831393920 00000100:00100000:3.0:1785394042.385180:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831393920 00000100:00100000:3.0:1785394042.385247:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785394042.385260:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785394042.385714:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831393920:12345-0@lo:503:mount.lustre.0 Request processed in 457us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.385723:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785394042.385932:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831393920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785394042.387038:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785394042.390443:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785394042.390546:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394042.390606:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394048 00000100:00100000:1.0:1785394042.390614:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394048 00000100:00100000:1.0:1785394042.390657:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785394042.390666:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831394048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785394042.395128:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.398533:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831394048:12345-0@lo:502:mount.lustre.0 Request processed in 7857us (7977us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.398549:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1785394042.398661:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1785394042.398980:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1785394042.399057:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1785394042.399093:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1785394042.399144:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1785394042.399182:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1785394042.399234:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1785394042.399668:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1785394042.399699:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1785394042.399767:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1785394042.399801:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1785394042.399830:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1785394042.399871:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1785394042.399902:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1785394042.399936:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1785394042.399988:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1785394042.400038:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1785394042.402227:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1785394042.402416:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1785394042.402493:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1785394042.402529:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1785394042.402625:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1785394042.402666:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1785394042.402696:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1785394042.402739:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1785394042.402787:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1785394042.402817:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1785394042.402859:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1785394042.402890:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1785394042.402920:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1785394042.402970:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1785394042.403008:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1785394042.406127:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1785394042.407632:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1785394042.407735:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1785394042.407768:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1785394042.407831:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1785394042.407866:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1785394042.407895:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1785394042.407940:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1785394042.407972:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1785394042.418463:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785394042.418626:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.418683:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1785394042.418782:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394176 00000100:00100000:2.0:1785394042.418792:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394176 00000100:00100000:2.0:1785394042.418848:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785394042.418858:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831394176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785394042.419146:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831394176:12345-0@lo:502:mount.lustre.0 Request processed in 288us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394042.419155:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785394042.419664:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1785394042.419865:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1785394042.419892:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1785394042.425362:0:15432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1785394042.425396:0:15432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93acf7253380) 00000020:00000080:2.0:1785394042.425454:0:15432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1785394042.425691:0:15432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93acce59a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1785394042.425696:0:15432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93acce59a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1785394042.425699:0:15432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93acce59a000 3 00010000:00080000:2.0:1785394042.425736:0:15432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ace00c0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1785394042.427549:0:15432:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1785394042.427686:0:15432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1785394042.427752:0:15432:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1785394042.427766:0:15432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcc9b96d8b362ac8f 00000100:00080000:2.0:1785394042.427785:0:15432:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785394042.427790:0:15432:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93ace00c0000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1785394042.427863:0:15432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d58a80 x1872120831394304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785394042.427907:0:15432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785394042.428534:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831394304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1785394042.428646:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1785394042.429200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394042.429205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785394042.429208:0:8:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785394042.429213:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1785394042.429217:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1785394042.429222:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394042.429249:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d73800 x1872120831394560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785394042.429314:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394042.429325:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831394432:0@lo:400:kworker.0 00000100:00100000:3.0:1785394042.429363:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.429395:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831394688:0@lo:400:kworker.0 00000100:00100000:3.0:1785394042.429431:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.429452:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394042.429458:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831394816:0@lo:400:kworker.0 00000100:00100000:3.0:1785394042.429480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.429517:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394304 00000100:00100000:3.0:1785394042.429525:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394304 00000100:00100000:3.0:1785394042.429549:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394688 00000100:00100000:3.0:1785394042.429552:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394688 00000100:00100000:3.0:1785394042.429604:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394816 00000100:00100000:3.0:1785394042.429607:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394816 00000100:00100000:3.0:1785394042.429633:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785394042.429642:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831394688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394042.429695:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831394688:12345-0@lo:400:kworker.0 Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.429702:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785394042.429728:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785394042.429734:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831394816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394042.429761:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831394816:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.429767:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785394042.429777:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785394042.429781:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1872120831394304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1785394042.429802:0:14116:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1785394042.429837:0:14116:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcc9b96d8b362ac96 00000004:00100000:3.0:1785394042.429855:0:14116:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1785394042.429885:0:14116:0:(import.c:65:import_set_state_nolock()) ffff93acc9364000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785394042.429931:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1872120831394304:12345-0@lo:38:llog_process_th.0 Request processed in 148us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.429937:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1785394042.429955:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785394042.430136:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d70700 x1872120831394816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394042.430150:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831394816:0@lo:400:kworker.0 00010000:00080000:3.0:1785394042.430162:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d71880 x1872120831394688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394042.430171:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831394688:0@lo:400:kworker.0 00000100:00100000:1.0:1785394042.431143:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831394560:0@lo:8:kworker.0 00000100:00100000:1.0:1785394042.431185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1785394042.431217:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93acf7d58a80 x1872120831394304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785394052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785394042.432596:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785394042.432607:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1785394042.432617:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1785394042.432624:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1785394042.432628:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93ace00c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785394042.432636:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1872120831394304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1785394042.435403:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394432 00000100:00100000:1.0:1785394042.435426:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394432 00000100:00100000:1.0:1785394042.435493:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394560 00000100:00100000:1.0:1785394042.435497:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394560 00000100:00100000:1.0:1785394042.435523:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785394042.435536:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831394432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394042.435664:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831394432:12345-0@lo:400:kworker.0 Request processed in 129us (6299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394042.435673:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785394042.435691:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785394042.435696:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831394560:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1785394042.435746:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831394560:12345-0@lo:8:kworker.0 Request processed in 48us (4560us total) trans 0 rc -11/-11 00000100:00100000:1.0:1785394042.435753:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785394042.435793:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785394042.435801:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785394042.435806:0:3314:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1785394042.435810:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831394560:0@lo:8:kworker.0 00000100:00080000:1.0:1785394042.435832:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785394042.435868:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831394432:0@lo:400:kworker.0 00000040:00080000:3.0:1785394042.463282:0:15432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1785394042.463475:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1785394042.463511:0:15422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785394042.463536:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac81 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.463562:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93abc31b2e00/0xcc9b96d8b362ac7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ac81 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785394042.463669:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785394042.463671:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785394042.463673:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394042.463674:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394042.463676:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394042.463677:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394042.463679:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394042.463681:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394042.463682:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785394042.463687:0:15422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1785394042.463690:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785394042.463691:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785394042.463692:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394042.463693:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394042.463694:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394042.463696:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394042.463697:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394042.463698:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394042.463699:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785394042.463733:0:15422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785394042.463771:0:15422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785394042.463867:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.463926:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831394944 00000100:00100000:3.0:1785394042.463934:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831394944 00000100:00100000:3.0:1785394042.463987:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785394042.463997:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:15422:x1872120831394944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1785394042.464029:0:14109:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1785394042.464046:0:14109:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1785394042.467894:0:15422:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc842ef00 going to sleep for 11 seconds 20000000:01000000:2.0:1785394042.550081:0:14109:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785394042.550102:0:14109:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1785394042.550361:0:14131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785394042.550370:0:14131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785394042.550398:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.550429:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 19 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.550440:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.550493:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 19 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.550512:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 19 pid: 14110 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394042.550530:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831395072:0@lo:104: 00000100:00100000:0.0:1785394042.550639:0:14131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394042.550707:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf2f62480 going to sleep for 11 seconds 00000100:00100000:3.0:1785394042.550944:0:14099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395072 00000100:00100000:3.0:1785394042.550956:0:14099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395072 00000100:00100000:3.0:1785394042.551036:0:14099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785394042.551046:0:14099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831395072:12345-0@lo:104: 00010000:00010000:3.0:1785394042.551062:0:14099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.551142:0:14099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785394042.551148:0:14099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:14131:x1872120831395072:12345-0@lo:104: Request processed in 105us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.551155:0:14099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785394042.551279:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14131:1872120831395072:0@lo:104: 00010000:00010000:2.0:1785394042.551302:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.552592:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394042.552622:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.552633:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:0.0:1785394042.552639:0:14104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.552665:0:14104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785394042.552672:0:14104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394042.552678:0:14104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785394042.552725:0:14104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.552750:0:14104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785394042.552814:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394042.552836:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d1800/0xcc9b96d8b362ab70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab77 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394042.552849:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785394042.552869:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831395200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785394042.552874:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394042.552899:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394042.552902:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394042.552919:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394042.553020:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395200 00000100:00100000:3.0:1785394042.553026:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395200 00010000:00010000:3.0:1785394042.553045:0:14101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 20 pid: 14110 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394042.553077:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785394042.553084:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:daecb8d0-f73c-4aec-8915-f89616659996+20:3318:x1872120831395200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785394042.553094:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394042.553098:0:14101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 20 pid: 14110 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553109:0:14101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 20 pid: 14110 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553124:0:14101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc82ba200/0xcc9b96d8b362ab77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362ab70 expref: 20 pid: 14110 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553138:0:14101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553146:0:14101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785394042.553168:0:14101:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003522955s 00010000:00010000:3.0:1785394042.553173:0:14101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553180:0:14101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553186:0:14101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553192:0:14101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553198:0:14101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394042.553201:0:14101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553209:0:14101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553225:0:14101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553234:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394042.553265:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831395200:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394042.553271:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1785394042.553292:0:14131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553323:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394042.553333:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acd7c58000/0xcc9b96d8b362ac9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394042.553368:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831395200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785394042.584532:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+18:15422:x1872120831394944:12345-0@lo:253:mount.lustre.0 Request processed in 120526us (120656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394042.584549:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785394042.584664:0:15422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:daecb8d0-f73c-4aec-8915-f89616659996:15422:1872120831394944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785394042.584701:0:15422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1785394042.584712:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785394042.584715:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785394042.584716:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785394042.584718:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785394042.584719:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785394042.584720:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785394042.584722:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785394042.584724:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785394042.584726:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1785394042.584771:0:15422:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785394042.601779:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394042.603468:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394042.603682:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394042.603844:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785394042.603988:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785394042.604223:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1785394042.607481:0:15422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1785394042.861928:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1785394042.942850:0:15422:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1785394042.942861:0:15422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1785394042.942899:0:15422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785394042.942987:0:15422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785394042.943002:0:15422:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1785394042.943038:0:15422:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1785394043.871805:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785394044.064376:0:14112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785394044.064394:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93abc19f3000 from 8 10000000:01000000:2.0:1785394044.064422:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785394044.064483:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394044.064499:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394044.064530:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394044.064561:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831395328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785394044.064674:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394044.064725:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1785394044.064857:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395328 00000100:00100000:3.0:1785394044.064867:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395328 00000100:00100000:3.0:1785394044.064926:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785394044.064936:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831395328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394044.064953:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394044.064967:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1a00/0xcc9b96d8b362acab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362aca4 expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394044.064993:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1a00/0xcc9b96d8b362acab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362aca4 expref: 19 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394044.065015:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1a00/0xcc9b96d8b362acab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aca4 expref: 19 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394044.065025:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1a00, rc 0) 00000100:00100000:3.0:1785394044.065068:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831395328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394044.065076:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785394044.065216:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831395328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785394044.065242:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362acab expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394044.065252:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362acab expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394044.065308:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831395456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1785394044.065339:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394044.065455:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd81ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1785394044.074468:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395456 00000100:00100000:3.0:1785394044.074486:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395456 00000100:00100000:2.0:1785394044.088780:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785394044.088797:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831395456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1785394044.088830:0:14109:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785394044.088859:0:14109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785394044.088862:0:14109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1785394044.089031:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831395456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 238us (23690us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394044.089486:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831395456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1785394044.089564:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785394044.090190:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362acab expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394044.090205:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0400/0xcc9b96d8b362aca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362acab expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394044.090479:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1785394044.896701:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394045.920442:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785394045.985198:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785394045.985236:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831395584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785394045.985334:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394045.985420:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395584 00000100:00100000:2.0:1785394045.985430:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395584 00000100:00100000:2.0:1785394045.985526:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785394045.985536:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831395584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785394045.985598:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785394045.985657:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831395584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394045.985664:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1785394045.985799:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785394045.986683:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831395584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785394046.944556:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785394047.521552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785394047.521560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785394047.521564:0:37:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785394047.521595:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93acf6ef8800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1785394047.521622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93acf7d72300 x1872120831395968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785394047.521691:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831395712:0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.521778:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394047.521792:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831395968:0@lo:8:kworker.0 00000100:00100000:1.0:1785394047.521826:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394047.521830:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831396352:0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.521862:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394047.521864:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831396096:0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.521881:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394047.521886:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831395840:0@lo:400:kworker.0 00000100:00100000:1.0:1785394047.521886:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394047.521904:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394047.521906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394047.521908:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831396224:0@lo:400:kworker.0 00000100:00100000:1.0:1785394047.521932:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394047.521944:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395712 00000100:00100000:3.0:1785394047.521951:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395712 00000100:00100000:1.0:1785394047.521956:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395968 00000100:00100000:1.0:1785394047.521958:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395968 00000100:00100000:1.0:1785394047.521987:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831395840 00000100:00100000:1.0:1785394047.521990:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831395840 00000100:00100000:3.0:1785394047.522008:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785394047.522022:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785394047.522024:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831395712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394047.522028:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831395840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.522075:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831395712:12345-0@lo:400:kworker.0 Request processed in 52us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394047.522075:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831395840:12345-0@lo:400:kworker.0 Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394047.522083:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785394047.522083:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785394047.522098:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785394047.522103:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1872120831395968:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1785394047.522115:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396352 00000100:00100000:3.0:1785394047.522118:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396352 00010000:00080000:1.0:1785394047.522128:0:14752:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000100:00100000:3.0:1785394047.522139:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396096 00000100:00100000:3.0:1785394047.522141:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396096 00000100:00100000:3.0:1785394047.522150:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396224 00000100:00100000:3.0:1785394047.522152:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396224 00000020:00000080:1.0:1785394047.522161:0:14752:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcc9b96d8b362acb2 00000100:00100000:3.0:1785394047.522164:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785394047.522169:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831396352:12345-0@lo:400:kworker.0 00002000:00100000:1.0:1785394047.522177:0:14752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93acec19b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1785394047.522182:0:14752:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1785394047.522185:0:14752:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1785394047.522197:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831396352:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394047.522202:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785394047.522221:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785394047.522226:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.522266:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831396096:12345-0@lo:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394047.522272:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785394047.522284:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785394047.522288:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831396224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.522310:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831396224:12345-0@lo:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394047.522314:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785394047.522368:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831395840:0@lo:400:kworker.0 00000100:00100000:3.0:1785394047.522399:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831395712:0@lo:400:kworker.0 00010000:00080000:3.0:1785394047.522410:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988380 x1872120831396352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394047.522419:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831396352:0@lo:400:kworker.0 00010000:00080000:3.0:1785394047.522450:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7d73800 x1872120831396224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394047.522457:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831396224:0@lo:400:kworker.0 00010000:00080000:3.0:1785394047.522465:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7d70380 x1872120831396096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785394047.522472:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831396096:0@lo:400:kworker.0 00002000:00080000:1.0:1785394047.522589:0:14752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785394047.522614:0:14752:0:(import.c:65:import_set_state_nolock()) ffff93acec198800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394047.522660:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1872120831395968:12345-0@lo:8:kworker.0 Request processed in 555us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394047.522666:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1785394047.524629:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf7d72300 x1872120831395968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785394072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785394047.524650:0:3314:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1785394047.524664:0:3314:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1785394047.524671:0:3314:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1785394047.524676:0:3314:0:(import.c:65:import_set_state_nolock()) ffff93acf6ef8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1785394047.524697:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1785394047.524705:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1872120831395968:0@lo:8:kworker.0 00000004:00080000:3.0:1785394047.524773:0:14140:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1785394047.524796:0:14140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14140:1872120831396608:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1785394047.524846:0:14140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394047.524872:0:14140:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd08c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1785394047.524896:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831396480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785394047.524935:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785394047.525077:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785394047.525083:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1785394047.525352:0:14139:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1785394047.525641:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396480 00000100:00100000:0.0:1785394047.525651:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396480 00000100:00100000:0.0:1785394047.525710:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394047.525720:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831396480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785394047.525756:0:14755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394047.525805:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1872120831396480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394047.525812:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1785394047.525828:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1785394047.526026:0:14139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 579557454440ns, next at 0ns, rc = 0 00000100:00100000:3.0:1785394047.528709:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396608 00000100:00100000:3.0:1785394047.528722:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396608 00000100:00100000:3.0:1785394047.528775:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785394047.528784:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14140:x1872120831396608:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1785394047.533025:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acff988380 x1872120831396480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785394063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785394047.533060:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831396480:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1785394047.540669:0:14751:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1785394047.540684:0:14751:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1785394047.540690:0:14751:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1785394047.569240:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.569255:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569277:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.569283:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.569291:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569312:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569325:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569334:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569358:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785394047.569393:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785394047.569400:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.569409:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394047.569414:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.572403:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.572867:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.572877:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362acb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.572906:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.572909:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.572911:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.580946:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.580962:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.581729:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.581735:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.581744:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.581777:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.581790:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.581800:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.581823:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785394047.583835:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.583846:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.583859:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.583863:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.583868:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.583878:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.583887:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.583905:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.583933:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785394047.584335:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785394047.584351:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584360:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.584364:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584381:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584403:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584410:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027260b05/0xcc9b96d8b362acc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584438:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.584442:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584449:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.584452:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584461:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584472:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584479:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d83e1fc6/0xcc9b96d8b362acc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.584492:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.584494:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.584496:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394047.590721:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.592875:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.592886:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.592906:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.592918:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.592926:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.592944:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.592955:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.592979:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.592999:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.593012:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.593018:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.593028:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.593033:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.593044:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.593062:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.593083:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362acce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.593101:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.593104:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.593106:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.596329:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.596345:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.596363:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.596368:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.596383:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.596397:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.596407:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.596414:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599567:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.599602:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.599617:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599630:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.599635:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599646:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599669:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599676:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362acd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.599695:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.599697:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.599699:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.605697:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.605714:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.605734:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.605740:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.605747:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.605778:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.605790:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.605799:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.605820:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785394047.606333:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.606406:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.606415:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.606420:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.606428:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.606457:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.606464:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000237e92a7/0xcc9b96d8b362acdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.606485:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.606487:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.606489:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785394047.612003:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1785394047.613005:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.613017:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613038:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.613043:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.613050:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613065:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613076:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613098:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613115:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785394047.613653:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.613660:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613670:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.613673:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.613678:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613687:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613696:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613704:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.613720:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1785394047.614112:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.614118:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614132:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.614135:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.614139:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614149:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614158:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614165:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614173:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1785394047.614364:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785394047.614382:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614391:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.614396:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614405:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614424:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614432:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a51b185a/0xcc9b96d8b362ace3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614463:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785394047.614467:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614474:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.614478:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614486:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614497:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614504:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02cbcf1/0xcc9b96d8b362acea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614515:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.614518:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614525:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.614529:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614547:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785394047.614553:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785394047.614558:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614559:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614566:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036ddd449/0xcc9b96d8b362acf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614567:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.614587:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.614592:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614599:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.614601:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614601:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.614604:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.614618:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614627:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.614644:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785394047.614690:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.614695:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614703:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.614706:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614714:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614725:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614742:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad9a3712/0xcc9b96d8b362acf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.614757:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.614760:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.614761:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394047.614833:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.615029:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.615035:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.615044:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.615047:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.615051:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.615060:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.615068:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.615075:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.615104:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785394047.615314:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.615319:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.615326:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.615329:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.615337:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.615415:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.615423:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000014233a5/0xcc9b96d8b362acff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.615436:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.615438:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.615440:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.624775:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.624794:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.624817:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.624821:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.624828:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.624844:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.624856:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.624865:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.624891:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785394047.625495:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394047.625504:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.625515:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394047.625520:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.625530:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.625555:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.625601:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ff7788d/0xcc9b96d8b362ad06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.625625:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394047.625627:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394047.625629:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.627091:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.627102:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.627118:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.627128:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.627135:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.627149:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.627159:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.627168:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.627186:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785394047.629544:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.629556:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.629619:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.629624:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.629632:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.629637:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.629645:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.629646:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.629656:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.629656:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.629661:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.629672:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.629672:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.629689:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785394047.629692:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.629700:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.629700:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff17c0ee/0xcc9b96d8b362ad0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.629722:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.629725:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.629726:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.630475:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.630478:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.630480:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.630510:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.630521:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394047.630524:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.630532:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.630546:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.630554:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000068a494/0xcc9b96d8b362ad14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.630601:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.630604:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.630605:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.643515:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.643531:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.643560:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.643565:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.643625:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.643644:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.643656:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.643665:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.643688:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785394047.644087:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.644092:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644101:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.644105:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.644109:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644118:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644137:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644144:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644168:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785394047.644288:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785394047.644297:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644307:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.644312:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644322:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644342:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644350:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e17232/0xcc9b96d8b362ad1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644367:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.644370:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644399:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.644402:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644410:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644430:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644438:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644451:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.644453:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.644455:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.644551:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.644557:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644565:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.644568:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.644591:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644601:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644610:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644618:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.644645:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.644687:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.644693:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644701:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.644705:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644713:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644731:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644739:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.644752:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.644754:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.644756:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.645044:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.645050:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645060:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.645062:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.645066:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645074:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645082:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645089:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645109:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785394047.645506:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.645512:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645520:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.645529:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.645534:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645543:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645552:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645559:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.645595:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785394047.645743:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785394047.645749:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645757:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.645761:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645769:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645783:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645791:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645815:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.645818:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645824:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.645827:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645834:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645842:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645848:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.645859:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.645861:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.645862:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.645869:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.645985:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.645991:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.646000:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.646003:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.646008:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.646018:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.646025:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.646038:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.646058:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.646276:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.646281:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.646288:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.646297:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.646306:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.646328:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.646337:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.646350:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.646352:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.646354:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.646466:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785394047.652945:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785394047.652960:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.652983:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=579s v=(0 0) 00010000:00010000:0.0:1785394047.652989:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394047.652997:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.653019:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.653031:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.653040:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394047.653060:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.654276:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.654285:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.654296:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c59800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.654301:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.654321:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.654344:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.654360:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6e5a38e/0xcc9b96d8b362ad45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.654388:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.654390:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.654393:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.655146:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.655152:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.655164:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.655168:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.655176:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.655187:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.655196:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.655204:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.655222:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785394047.655554:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785394047.655562:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.655588:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785394047.655592:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.655600:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.655612:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.655619:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d036b6/0xcc9b96d8b362ad4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.655634:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.655635:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.655637:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785394047.656782:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785394047.656795:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.656808:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=579s v=(0 0) 00010000:00010000:2.0:1785394047.656812:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394047.656817:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.656826:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.656834:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.656842:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.656860:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785394047.660632:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.660663:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661237:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785394047.661247:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661272:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394047.661278:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661289:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661313:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661321:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b9384c3/0xcc9b96d8b362ad53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394047.661343:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.661345:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394047.661347:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.661520:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.661527:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.661534:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.661549:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.661559:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.661581:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.661599:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.663507:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.663519:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.663531:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.663536:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.663547:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.663600:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.663609:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee0f908/0xcc9b96d8b362ad5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.663625:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.663627:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.663629:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.666436:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.666454:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.666533:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.666540:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.666549:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.666567:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.666605:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.666614:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.666639:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785394047.666663:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.666671:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.666680:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.666684:0:14103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.666693:0:14103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.666710:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.666718:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006607220d/0xcc9b96d8b362ad61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.666767:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.666770:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.666772:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785394047.668052:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.668059:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.668071:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.668075:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.668080:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.668090:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.668099:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.668107:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.668182:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785394047.670834:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.670847:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.670863:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.670867:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.670873:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.670885:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.670895:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.670902:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.675650:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785394047.675665:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.675689:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.675694:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.675710:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.675748:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.675756:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4a400f/0xcc9b96d8b362ad68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.676456:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.676462:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.676475:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.676487:0:14104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.676495:0:14104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.676516:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.676523:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.676525:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.676527:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.678979:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785394047.678992:0:14751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a644778/0xcc9b96d8b362ad6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785394047.680996:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785394047.681007:0:14751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.681032:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=579s v=(0 0) 00010000:00010000:3.0:1785394047.681038:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394047.681046:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.681062:0:14751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.681072:0:14751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394047.681080:0:14751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.682874:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394047.682887:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.682900:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394047.682906:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.682917:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.682939:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394047.682950:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.682958:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394047.682960:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785394047.684814:0:14751:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785394047.684828:0:14751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3140588/0xcc9b96d8b362ad76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1785394047.685195:0:14751:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1785394047.686657:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14140:x1872120831396608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 157867us (161806us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394047.686670:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785394047.686865:0:14140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14140:1872120831396608:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1785394047.686894:0:14140:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1785394047.686952:0:14140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14140:1872120831396736:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785394047.686994:0:14140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394047.687055:0:14140:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc95a0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1785394047.687805:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396736 00000100:00100000:3.0:1785394047.687814:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396736 00000100:00100000:3.0:1785394047.687866:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785394047.687875:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14140:x1872120831396736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1785394047.687940:0:14752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1785394047.691798:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785394047.707409:0:14140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14140:1872120831396736:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1785394047.707435:0:14140:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1785394047.707548:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14140:x1872120831396736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18247us (19127us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1785394047.707563:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:2.0:1785394047.840291:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785394047.968478:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785394048.209641:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1785394048.211442:0:7533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1785394048.991877:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394050.020319:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394051.041045:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394051.104862:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785394051.104892:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831396864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785394051.104987:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394051.105087:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396864 00000100:00100000:0.0:1785394051.105096:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396864 00000100:00100000:0.0:1785394051.105158:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785394051.105168:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831396864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785394051.105211:0:14755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394051.105267:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831396864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394051.105274:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1785394051.105297:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785394051.105340:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831396864:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1785394051.672699:0:15779:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785394052.072743:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394052.639995:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831396992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785394052.640084:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394052.640169:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831396992 00000100:00100000:0.0:1785394052.640188:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831396992 00000100:00100000:0.0:1785394052.640931:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785394052.640944:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831396992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785394052.640999:0:14755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394052.642350:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831396992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1398us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394052.642362:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1785394052.642395:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785394052.642740:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831397120:0@lo:400:kworker.0 00000100:00100000:1.0:1785394052.642794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394052.642832:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831397632:0@lo:400:kworker.0 00000100:00100000:1.0:1785394052.642862:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394052.642888:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785394052.642894:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831397248:0@lo:400:kworker.0 00000100:00100000:1.0:1785394052.642933:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394052.642968:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397120 00000100:00100000:1.0:1785394052.642975:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397120 00000100:00100000:1.0:1785394052.643014:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785394052.643022:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394052.643060:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831397120:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394052.643067:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785394052.643100:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397632 00000100:00100000:1.0:1785394052.643103:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397632 00000100:00100000:1.0:1785394052.643135:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785394052.643141:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831397632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394052.643169:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1872120831397632:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394052.643175:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785394052.643214:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831397120:0@lo:400:kworker.0 00010000:00080000:1.0:1785394052.643230:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf9630000 x1872120831397632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785394052.643300:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1872120831397632:0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.643691:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397248 00000100:00100000:0.0:1785394052.643696:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397248 00000100:00100000:0.0:1785394052.643729:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394052.643736:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831397248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.643781:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831397248:12345-0@lo:400:kworker.0 Request processed in 46us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394052.643788:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394052.643811:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831397376:0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.643839:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394052.643862:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785394052.643868:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831397504:0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.643889:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394052.643914:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397376 00000100:00100000:0.0:1785394052.643918:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397376 00000100:00100000:0.0:1785394052.643938:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397504 00000100:00100000:0.0:1785394052.643941:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397504 00000100:00100000:0.0:1785394052.643957:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785394052.643963:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831397376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.643998:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1872120831397376:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394052.644005:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785394052.644017:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785394052.644030:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831397504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.644060:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1872120831397504:12345-0@lo:400:kworker.0 Request processed in 30us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394052.644066:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1785394052.644087:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785394052.644106:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf9630e00 x1872120831397504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785394052.644117:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1872120831397504:0@lo:400:kworker.0 00010000:00080000:0.0:1785394052.644126:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93acf9633b80 x1872120831397376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785394068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785394052.644134:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1872120831397376:0@lo:400:kworker.0 00000100:00100000:0.0:1785394052.644155:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf9632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831397248:0@lo:400:kworker.0 00000100:00100000:2.0:1785394052.649680:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1785394052.649723:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831396992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785394053.094759:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394054.114532:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394054.580691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394054.580996:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273472 00000100:00100000:3.0:1785394054.581010:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273472 00000100:00100000:3.0:1785394054.581065:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1785394054.581074:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1872120807273472:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:3.0:1785394054.581115:0:14108:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 48ad2632-9b6b-4944-a25d-e13ca0e061fc@192.168.203.12@tcp t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:3.0:1785394054.581150:0:14108:0:(genops.c:1406:class_connect()) connect: client 48ad2632-9b6b-4944-a25d-e13ca0e061fc, cookie 0xcc9b96d8b362ad7d 00000100:00080000:3.0:1785394054.581528:0:14108:0:(import.c:65:import_set_state_nolock()) ffff93abc2047800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785394054.581811:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+5:2357:x1872120807273472:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 735us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394054.581820:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1785394054.602806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.608457:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273600 00000100:00100000:2.0:1785394054.608475:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273600 00000100:00100000:2.0:1785394054.608545:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1785394054.608557:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+5:13704:x1872120807273600:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785394054.608595:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394054.608618:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b362ad84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd9aa expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.608652:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b362ad84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9aa expref: 6 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.608665:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1a00/0xcc9b96d8b362ad84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9aa expref: 6 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.608675:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1a00, rc 0) 00000100:00100000:2.0:1785394054.608760:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+6:13704:x1872120807273600:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 204us (5968us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.608767:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:0.0:1785394054.637955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394054.638057:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273728 00000100:00100000:3.0:1785394054.638071:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273728 00000100:00100000:3.0:1785394054.638140:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:3.0:1785394054.638152:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+6:13704:x1872120807273728:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1785394054.642488:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+6:13704:x1872120807273728:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 4326us (4536us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785394054.642504:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1785394054.647740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394054.649045:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273856 00000100:00100000:0.0:1785394054.649058:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273856 00000100:00100000:0.0:1785394054.649130:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1785394054.649141:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+6:13704:x1872120807273856:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785394054.649171:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394054.649194:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c59600/0xcc9b96d8b362ad8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd9b1 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394054.649234:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c59600/0xcc9b96d8b362ad8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9b1 expref: 7 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394054.649246:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c59600/0xcc9b96d8b362ad8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9b1 expref: 7 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394054.649269:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59600, rc 0) 00000100:00100000:0.0:1785394054.649353:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+7:13704:x1872120807273856:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 213us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394054.649361:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:1.0:1785394054.655982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.668318:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807273984 00000100:00100000:2.0:1785394054.668353:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807273984 00000100:00100000:2.0:1785394054.668437:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1785394054.668448:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+7:13704:x1872120807273984:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785394054.668828:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13704:x1872120807273984:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 380us (12857us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.668837:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1785394054.683707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394054.687398:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274112 00000100:00100000:3.0:1785394054.687412:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274112 00000100:00100000:3.0:1785394054.687511:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:3.0:1785394054.687522:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13704:x1872120807274112:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785394054.687905:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13704:x1872120807274112:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 384us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394054.687913:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1785394054.697373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394054.698753:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274240 00000100:00100000:1.0:1785394054.698858:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274240 00000100:00100000:1.0:1785394054.698967:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1785394054.698979:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13723:x1872120807274240:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785394054.700281:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13723:x1872120807274240:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 1302us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394054.700292:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1785394054.761436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.764513:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274368 00000100:00100000:2.0:1785394054.764531:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274368 00000100:00100000:2.0:1785394054.764620:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:2.0:1785394054.764631:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13723:x1872120807274368:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785394054.767548:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13723:x1872120807274368:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 2904us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.767590:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1785394054.788646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394054.788694:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274496 00000100:00100000:1.0:1785394054.788708:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274496 00000100:00100000:1.0:1785394054.788767:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1785394054.788779:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+8:13704:x1872120807274496:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785394054.788803:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394054.788828:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93abc31b3c00/0xcc9b96d8b362ad92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd9db expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394054.788863:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93abc31b3c00/0xcc9b96d8b362ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9db expref: 9 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394054.788877:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93abc31b3c00/0xcc9b96d8b362ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9db expref: 9 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394054.788888:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3c00, rc 0) 00000100:00100000:1.0:1785394054.788951:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+9:13704:x1872120807274496:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 174us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394054.788959:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1785394054.806658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.806724:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274624 00000100:00100000:2.0:1785394054.806738:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274624 00000100:00100000:2.0:1785394054.808919:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:2.0:1785394054.809188:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+9:13704:x1872120807274624:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:2.0:1785394054.809231:0:14108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785394054.809264:0:14108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785394054.809269:0:14108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785394054.809273:0:14108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785394054.809276:0:14108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1785394054.860850:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+9:13704:x1872120807274624:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 51651us (54184us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394054.860875:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1785394054.865977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.866258:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274752 00000100:00100000:2.0:1785394054.866279:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274752 00000100:00100000:2.0:1785394054.866348:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1785394054.866358:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+9:13704:x1872120807274752:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785394054.866378:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394054.866398:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dd9e2 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.866433:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 10 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.866445:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 10 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394054.866456:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0e00, rc 0) 00000100:00100000:2.0:1785394054.866517:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13704:x1872120807274752:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 160us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.866524:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:2.0:1785394054.881552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394054.884259:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807274880 00000100:00100000:1.0:1785394054.884290:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807274880 00000100:00100000:1.0:1785394054.884397:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1785394054.884409:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13704:x1872120807274880:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785394054.884756:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13704:x1872120807274880:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 348us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394054.886834:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:1.0:1785394054.905231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394054.906120:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275008 00000100:00100000:3.0:1785394054.906132:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275008 00000100:00100000:3.0:1785394054.906192:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:3.0:1785394054.906203:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13704:x1872120807275008:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785394054.906535:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13704:x1872120807275008:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 333us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394054.906544:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:0.0:1785394054.910384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394054.913224:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275136 00000100:00100000:2.0:1785394054.913238:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275136 00000100:00100000:2.0:1785394054.913364:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1785394054.913376:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13728:x1872120807275136:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785394054.913938:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13728:x1872120807275136:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 563us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.913957:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1785394054.934499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394054.938270:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275264 00000100:00100000:3.0:1785394054.938286:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275264 00000100:00100000:2.0:1785394054.938439:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1785394054.938467:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13728:x1872120807275264:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785394054.939166:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13728:x1872120807275264:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 699us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394054.939175:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:1.0:1785394054.966980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394054.968901:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275392 00000100:00100000:0.0:1785394054.968915:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275392 00000100:00100000:0.0:1785394054.969018:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1785394054.969028:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1872120807275392:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1785394054.969064:0:14115:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c@192.168.203.12@tcp t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:0.0:1785394054.969118:0:14115:0:(genops.c:1406:class_connect()) connect: client 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c, cookie 0xcc9b96d8b362ada0 00000004:00100000:0.0:1785394054.970526:0:14115:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1785394054.970538:0:14115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1785394055.116689:0:14115:0:(import.c:65:import_set_state_nolock()) ffff93acffb25000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785394055.116799:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2357:x1872120807275392:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 147770us (149884us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394055.116812:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1785394055.120677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394055.121197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394055.127069:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275520 00000100:00100000:2.0:1785394055.127091:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275520 00000100:00100000:2.0:1785394055.127594:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275648 00000100:00100000:2.0:1785394055.127598:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275648 00000100:00100000:2.0:1785394055.127622:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1785394055.127632:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:0:x1872120807275520:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785394055.127685:0:14117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785394055.127800:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:0:x1872120807275520:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 169us (7141us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394055.127807:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1785394055.127824:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785394055.127829:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807275648:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785394055.127838:0:14117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785394055.127855:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807275648:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 26us (6659us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394055.127861:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785394055.136448:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394055.136544:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275776 00000100:00080000:0.0:1785394055.136585:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785394055.136599:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275776 00000100:00100000:1.0:1785394055.136673:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1785394055.136684:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807275776:12345-192.168.203.12@tcp:40:mount.lustre.0 00010000:00010000:3.0:1785394055.136773:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394055.140499:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807275776:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 3802us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394055.140516:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1785394055.154342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394055.154428:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394055.154453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394055.154493:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394055.154541:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276288 00000100:00100000:2.0:1785394055.154552:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276288 00000100:00100000:2.0:1785394055.154630:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1785394055.154642:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:2359:x1872120807276288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394055.154733:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:2359:x1872120807276288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394055.154742:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:1.0:1785394055.156356:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807275904 00000100:00100000:1.0:1785394055.156366:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807275904 00000100:00100000:1.0:1785394055.156409:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276032 00000100:00100000:1.0:1785394055.156411:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276032 00000100:00100000:1.0:1785394055.156433:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394055.156440:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1872120807275904:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785394055.156473:0:14753:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c@192.168.203.12@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1785394055.156511:0:14753:0:(genops.c:1406:class_connect()) connect: client 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c, cookie 0xcc9b96d8b362ada7 00002000:00100000:1.0:1785394055.156526:0:14753:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c/ffff93abc125c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785394055.156554:0:14753:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785394055.156967:0:14753:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785394055.157002:0:14753:0:(import.c:65:import_set_state_nolock()) ffff93abc1258000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394055.157070:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2357:x1872120807275904:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 628us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394055.157095:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394055.157125:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394055.157131:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1872120807276032:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785394055.157147:0:14753:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c@192.168.203.12@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1785394055.157342:0:14753:0:(genops.c:1406:class_connect()) connect: client 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c, cookie 0xcc9b96d8b362adae 00002000:00100000:1.0:1785394055.157348:0:14753:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c/ffff93abc125e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785394055.157365:0:14753:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785394055.157563:0:14753:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785394055.157602:0:14753:0:(import.c:65:import_set_state_nolock()) ffff93abc125f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394055.157625:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2357:x1872120807276032:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 493us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394055.157632:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394055.161907:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276160 00000100:00100000:1.0:1785394055.161973:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276160 00000100:00100000:1.0:1785394055.162072:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785394055.162084:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807276160:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00080000:3.0:1785394055.170299:0:14118:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7062us 00000004:00200000:3.0:1785394055.207244:0:14118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785394055.207638:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13704:x1872120807276160:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 45547us (53311us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394055.207665:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1785394055.441315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394055.444368:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276416 00000100:00100000:1.0:1785394055.444387:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276416 00000100:00100000:1.0:1785394055.444555:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1785394055.444585:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13749:x1872120807276416:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:1.0:1785394055.444615:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394055.444651:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3000/0xcc9b96d8b362adb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda0c expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.444836:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.444874:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.444903:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394055.446378:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785394055.446385:0:14116:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1785394055.446543:0:14116:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.446618:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3000/0xcc9b96d8b362adb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda0c expref: 8 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.446657:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda0c expref: 7 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394055.446668:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:1.0:1785394055.446672:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785394055.446686:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b2200, rc 0) 00000100:00100000:1.0:1785394055.446951:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:13749:x1872120807276416:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 2369us (5634us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394055.446976:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:2.0:1785394056.160233:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785394056.224731:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831397760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785394056.224850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394056.225002:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397760 00000100:00100000:2.0:1785394056.225013:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397760 00000100:00100000:2.0:1785394056.225110:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785394056.225121:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831397760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785394056.225157:0:14755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1785394056.225247:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785394056.235798:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831397760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10666us (10935us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394056.235815:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785394056.236839:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831397760:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1785394057.056794:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785394057.184095:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785394057.762065:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831397888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785394057.762161:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394057.762695:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831398144:0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.762730:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394057.762761:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394057.762767:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831398272:0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.762794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394057.763073:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398272 00000100:00100000:0.0:1785394057.763082:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398272 00000100:00100000:0.0:1785394057.763155:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785394057.763167:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831398272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394057.763232:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831398272:12345-0@lo:400:kworker.0 Request processed in 67us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394057.763258:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785394057.763285:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831397888 00000100:00100000:0.0:1785394057.763289:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831397888 00000100:00100000:0.0:1785394057.763339:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785394057.763346:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831397888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785394057.763380:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394057.763417:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831397888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394057.763423:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1785394057.763439:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785394057.763489:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831398272:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.763853:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831398016:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.763894:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394057.763927:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831398528:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.763957:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394057.763975:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785394057.764094:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831398400:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.764121:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394057.764923:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398528 00000100:00100000:3.0:1785394057.764930:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398528 00000100:00100000:3.0:1785394057.764984:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398400 00000100:00100000:3.0:1785394057.764988:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398400 00000100:00100000:3.0:1785394057.765007:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785394057.765015:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831398528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.765058:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831398528:12345-0@lo:400:kworker.0 Request processed in 43us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394057.765064:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785394057.765079:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785394057.765085:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831398400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.765111:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1872120831398400:12345-0@lo:400:kworker.0 Request processed in 26us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394057.765117:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785394057.765288:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398144 00000100:00100000:1.0:1785394057.765293:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398144 00000100:00100000:1.0:1785394057.765338:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785394057.765346:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831398144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394057.765386:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831398144:12345-0@lo:400:kworker.0 Request processed in 42us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394057.765393:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785394057.765446:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831397888:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785394057.765593:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785394057.765616:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831398144:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.765928:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1872120831398400:0@lo:400:kworker.0 00000100:00100000:2.0:1785394057.765958:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831398528:0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.766075:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398016 00000100:00100000:3.0:1785394057.766080:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398016 00000100:00100000:3.0:1785394057.767874:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785394057.767890:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc10c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831398016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394057.767968:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc10c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831398016:12345-0@lo:400:kworker.0 Request processed in 83us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394057.767996:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785394057.769628:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831398016:0@lo:400:kworker.0 00000100:00100000:1.0:1785394057.826734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394057.830649:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276544 00000100:00100000:3.0:1785394057.830670:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276544 00000100:00100000:3.0:1785394057.830787:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1785394057.830800:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:13802:x1872120807276544:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1785394057.830858:0:14115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1785394057.830993:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:13802:x1872120807276544:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 195us (4270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394057.831001:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:0.0:1785394057.834602:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785394057.835336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394057.835410:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276672 00000100:00100000:0.0:1785394057.835421:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276672 00000100:00100000:0.0:1785394057.835496:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1785394057.835506:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13802:x1872120807276672:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1785394057.835557:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394057.835678:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13802:x1872120807276672:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394057.835685:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:2.0:1785394057.836453:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785394057.837400:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394057.838221:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276800 00000100:00100000:0.0:1785394057.838231:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276800 00000100:00100000:0.0:1785394057.838302:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1785394057.838318:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13802:x1872120807276800:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1785394057.838342:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394057.838417:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:13802:x1872120807276800:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 101us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394057.838424:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:2.0:1785394057.838522:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785394058.142552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394058.147336:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807276928 00000100:00100000:3.0:1785394058.147355:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807276928 00000100:00100000:3.0:1785394058.147449:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:3.0:1785394058.147461:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+10:13836:x1872120807276928:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785394058.147485:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394058.147509:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1400/0xcc9b96d8b362adc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda13 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394058.147545:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1400/0xcc9b96d8b362adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda13 expref: 11 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394058.147559:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1400/0xcc9b96d8b362adc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda13 expref: 11 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394058.147597:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1400, rc 0) 00000100:00100000:3.0:1785394058.147672:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807276928:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 213us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394058.147700:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1785394058.155691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.155853:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277056 00000100:00100000:2.0:1785394058.155864:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277056 00000100:00100000:2.0:1785394058.155930:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1785394058.155942:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807277056:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785394058.156289:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807277056:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 349us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.156298:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:0.0:1785394058.170808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.170918:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277184 00000100:00100000:2.0:1785394058.170931:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277184 00000100:00100000:2.0:1785394058.171000:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1785394058.171011:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807277184:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785394058.171384:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807277184:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 373us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.171828:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1785394058.176033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394058.180450:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277312 00000100:00100000:3.0:1785394058.180468:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277312 00000100:00100000:3.0:1785394058.180544:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:3.0:1785394058.180555:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13841:x1872120807277312:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785394058.180931:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13841:x1872120807277312:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 378us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394058.180940:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1785394058.207154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.207283:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277440 00000100:00100000:2.0:1785394058.207295:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277440 00000100:00100000:2.0:1785394058.207364:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:2.0:1785394058.207373:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13841:x1872120807277440:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785394058.207882:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13841:x1872120807277440:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 507us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.207900:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00010000:00010000:3.0:1785394058.208187:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394058.219816:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.220111:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277568 00000100:00100000:0.0:1785394058.220122:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277568 00000100:00100000:0.0:1785394058.220196:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1785394058.220206:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13836:x1872120807277568:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785394058.220225:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394058.220255:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acd7c59a00/0xcc9b96d8b362adca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda3d expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.220286:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acd7c59a00/0xcc9b96d8b362adca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda3d expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.220298:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acd7c59a00/0xcc9b96d8b362adca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda3d expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.220318:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59a00, rc 0) 00000100:00100000:0.0:1785394058.220379:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13836:x1872120807277568:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 175us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.220385:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1785394058.223674:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.223759:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277696 00000100:00100000:2.0:1785394058.223768:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277696 00000100:00100000:2.0:1785394058.223817:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1785394058.223826:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13836:x1872120807277696:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:2.0:1785394058.223852:0:14110:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785394058.223882:0:14110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785394058.223886:0:14110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785394058.223889:0:14110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785394058.223891:0:14110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1785394058.225242:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13836:x1872120807277696:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 1413us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.225259:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:0.0:1785394058.239006:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.239097:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277824 00000100:00100000:2.0:1785394058.239109:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277824 00000100:00100000:2.0:1785394058.239230:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:2.0:1785394058.239241:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13836:x1872120807277824:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785394058.239261:0:14108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394058.239282:0:14108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda44 expref: -99 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394058.239325:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 13 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394058.239336:0:14108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 13 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394058.239365:0:14108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1000, rc 0) 00000100:00100000:2.0:1785394058.239429:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13836:x1872120807277824:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 190us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.239435:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1785394058.242893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394058.252311:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807277952 00000100:00100000:3.0:1785394058.252330:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807277952 00000100:00100000:0.0:1785394058.252591:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1785394058.252618:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13836:x1872120807277952:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785394058.252955:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13836:x1872120807277952:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 338us (10073us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.252963:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:2.0:1785394058.266385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.266501:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278080 00000100:00100000:0.0:1785394058.266514:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278080 00000100:00100000:0.0:1785394058.266629:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1785394058.266640:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13836:x1872120807278080:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1785394058.266909:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13836:x1872120807278080:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 270us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.266917:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1785394058.274230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394058.274369:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278208 00000100:00100000:2.0:1785394058.274380:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278208 00000100:00100000:2.0:1785394058.274438:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1785394058.274447:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13844:x1872120807278208:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785394058.274736:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13844:x1872120807278208:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 290us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394058.274745:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:1.0:1785394058.280067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.286445:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278336 00000100:00100000:0.0:1785394058.286477:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278336 00000100:00100000:0.0:1785394058.286613:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1785394058.286627:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13844:x1872120807278336:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785394058.286947:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13844:x1872120807278336:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 322us (6891us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.286955:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:1.0:1785394058.296295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.296396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.296422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.296446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.296476:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278464 00000100:00100000:1.0:1785394058.296487:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278464 00000100:00100000:1.0:1785394058.296524:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278848 00000100:00100000:1.0:1785394058.296527:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278848 00000100:00100000:1.0:1785394058.296555:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1785394058.296607:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2360:x1872120807278848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394058.296688:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2360:x1872120807278848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.296695:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1785394058.296716:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394058.296721:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf9630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1872120807278464:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:1.0:1785394058.296745:0:14117:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 01dc2679-0e90-4bb5-beb6-6fa722754450@192.168.203.12@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:1.0:1785394058.296784:0:14117:0:(genops.c:1406:class_connect()) connect: client 01dc2679-0e90-4bb5-beb6-6fa722754450, cookie 0xcc9b96d8b362add8 00000004:00100000:1.0:1785394058.296818:0:14117:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1785394058.296944:0:14117:0:(import.c:65:import_set_state_nolock()) ffff93ad0034c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394058.296989:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf9630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2357:x1872120807278464:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 266us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.296996:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394058.297015:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278976 00000100:00100000:1.0:1785394058.297019:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278976 00000100:00100000:1.0:1785394058.297040:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279104 00000100:00100000:1.0:1785394058.297043:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279104 00000100:00100000:1.0:1785394058.297060:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785394058.297066:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807278976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394058.297092:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807278976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.297098:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785394058.297109:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1785394058.297114:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807279104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394058.297150:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807279104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.297157:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1785394058.320764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.320806:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278592 00000100:00100000:1.0:1785394058.320817:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278592 00000100:00100000:1.0:1785394058.320887:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394058.320898:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+6:0:x1872120807278592:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785394058.320958:0:14117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785394058.321042:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+6:0:x1872120807278592:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 145us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.321051:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:1.0:1785394058.321079:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785394058.331515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.331659:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807278720 00000100:00100000:0.0:1785394058.331672:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807278720 00000100:00100000:0.0:1785394058.331741:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1785394058.331762:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807278720:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785394058.331802:0:14115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785394058.332046:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807278720:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 286us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.332077:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785394058.339210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.339595:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279232 00000100:00100000:0.0:1785394058.339607:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279232 00000100:00100000:0.0:1785394058.339664:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1785394058.339674:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807279232:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1785394058.340519:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807279232:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 843us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.340528:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1785394058.346250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.346337:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.346367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394058.346398:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279360 00000100:00100000:1.0:1785394058.346409:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279360 00000100:00100000:1.0:1785394058.346452:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279488 00000100:00100000:1.0:1785394058.346454:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279488 00000100:00100000:1.0:1785394058.346480:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785394058.346489:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1872120807279360:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785394058.346528:0:14751:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 01dc2679-0e90-4bb5-beb6-6fa722754450@192.168.203.12@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:1.0:1785394058.346563:0:14751:0:(genops.c:1406:class_connect()) connect: client 01dc2679-0e90-4bb5-beb6-6fa722754450, cookie 0xcc9b96d8b362addf 00002000:00100000:1.0:1785394058.346609:0:14751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 01dc2679-0e90-4bb5-beb6-6fa722754450/ffff93acd7583000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785394058.346623:0:14751:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785394058.346755:0:14751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785394058.346788:0:14751:0:(import.c:65:import_set_state_nolock()) ffff93acd7580800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394058.346861:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2357:x1872120807279360:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 372us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.346869:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785394058.346889:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1785394058.346893:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1872120807279488:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785394058.346907:0:14751:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 01dc2679-0e90-4bb5-beb6-6fa722754450@192.168.203.12@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:1.0:1785394058.346922:0:14751:0:(genops.c:1406:class_connect()) connect: client 01dc2679-0e90-4bb5-beb6-6fa722754450, cookie 0xcc9b96d8b362ade6 00002000:00100000:1.0:1785394058.346928:0:14751:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 01dc2679-0e90-4bb5-beb6-6fa722754450/ffff93acd7581000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785394058.346934:0:14751:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785394058.347172:0:14751:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785394058.347197:0:14751:0:(import.c:65:import_set_state_nolock()) ffff93acd7582800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785394058.347220:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2357:x1872120807279488:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 325us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394058.347227:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1785394058.352579:0:14119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279616 00000100:00100000:0.0:1785394058.352596:0:14119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279616 00000100:00100000:0.0:1785394058.352648:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785394058.352658:0:14119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807279616:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:0.0:1785394058.353658:0:14119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1785394058.355227:0:14119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13836:x1872120807279616:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 2563us (8981us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.355240:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000001:00100000:2.0:1785394058.395205:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c 00000100:00100000:1.0:1785394058.609385:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394058.609655:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279744 00000100:00100000:0.0:1785394058.609667:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279744 00000100:00100000:0.0:1785394058.609732:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1785394058.609749:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:13865:x1872120807279744:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:0.0:1785394058.609776:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394058.609804:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362aded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda6e expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.609889:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.609930:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.609945:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785394058.610566:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785394058.611246:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785394058.611357:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.611394:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362aded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 8 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.611415:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394058.611425:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:0.0:1785394058.611429:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785394058.611432:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c59800, rc 0) 00000100:00100000:0.0:1785394058.612450:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+7:13865:x1872120807279744:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 2703us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394058.612470:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:2.0:1785394059.231736:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785394059.442940:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 01dc2679-0e90-4bb5-beb6-6fa722754450 00000001:00100000:2.0:1785394059.442982:0:6656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c 00010000:00010000:2.0:1785394060.256439:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785394060.400937:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 01dc2679-0e90-4bb5-beb6-6fa722754450 00000001:00100000:0.0:1785394060.400962:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54ced0b8-95bd-40d4-bb9f-7a6e75b3691c 00010000:00010000:1.0:1785394061.280030:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394061.352651:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785394061.352681:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831398656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785394061.352770:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394061.352862:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398656 00000100:00100000:0.0:1785394061.352871:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398656 00000100:00100000:0.0:1785394061.352935:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785394061.352946:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831398656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785394061.352987:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394061.353031:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831398656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394061.353038:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1785394061.353059:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785394061.353096:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831398656:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1785394061.962224:0:15987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1785394062.310735:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394062.880584:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831399040:0@lo:400:kworker.0 00000100:00100000:0.0:1785394062.880674:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394062.880741:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785394062.880746:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831398912:0@lo:400:kworker.0 00000100:00100000:0.0:1785394062.880765:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394062.880779:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831399424:0@lo:400:kworker.0 00000100:00100000:0.0:1785394062.880806:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394062.880850:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399424 00000100:00100000:0.0:1785394062.880858:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399424 00000100:00100000:0.0:1785394062.880926:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785394062.880936:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831399424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394062.880995:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831399424:12345-0@lo:400:kworker.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394062.881003:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1785394062.881026:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785394062.881069:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831399424:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881329:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831398784:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881368:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394062.881402:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831399296:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881426:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394062.881447:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785394062.881453:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831399168:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881473:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394062.881497:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399296 00000100:00100000:3.0:1785394062.881500:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399296 00000100:00100000:3.0:1785394062.881526:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399168 00000100:00100000:3.0:1785394062.881529:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399168 00000100:00100000:3.0:1785394062.881543:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785394062.881549:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831399296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881613:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831399296:12345-0@lo:400:kworker.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394062.881642:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785394062.881657:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785394062.881664:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831399168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881695:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831399168:12345-0@lo:400:kworker.0 Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394062.881700:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1785394062.881716:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785394062.881734:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831399168:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881743:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831399296:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881791:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399040 00000100:00100000:3.0:1785394062.881794:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399040 00000100:00100000:3.0:1785394062.881837:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398912 00000100:00100000:3.0:1785394062.881841:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398912 00000100:00100000:3.0:1785394062.881862:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785394062.881868:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831399040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881904:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831399040:12345-0@lo:400:kworker.0 Request processed in 36us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394062.881909:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785394062.881919:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785394062.881924:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831398912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881945:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831398912:12345-0@lo:400:kworker.0 Request processed in 21us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394062.881949:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785394062.881976:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831398912:0@lo:400:kworker.0 00000100:00100000:3.0:1785394062.881984:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831399040:0@lo:400:kworker.0 00000100:00080000:3.0:1785394062.882014:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785394062.882343:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831398784 00000100:00100000:0.0:1785394062.882348:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831398784 00000100:00100000:0.0:1785394062.882376:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785394062.882383:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:3316:x1872120831398784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394062.882418:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:3316:x1872120831398784:12345-0@lo:400:kworker.0 Request processed in 36us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394062.882425:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785394062.882700:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831398784:0@lo:400:kworker.0 00000100:00100000:1.0:1785394062.889294:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831399552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785394062.889402:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394062.889539:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399552 00000100:00100000:3.0:1785394062.889548:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399552 00000100:00100000:3.0:1785394062.889625:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785394062.889635:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831399552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785394062.889682:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785394062.889730:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831399552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394062.889738:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785394062.894401:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831399552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785394063.334705:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785394063.511810:0:7533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 01dc2679-0e90-4bb5-beb6-6fa722754450 00000100:00100000:1.0:1785394063.558692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394063.558893:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280000 00000100:00100000:1.0:1785394063.558903:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280000 00000100:00100000:1.0:1785394063.558971:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280384 00000100:00100000:1.0:1785394063.558975:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280384 00000100:00100000:1.0:1785394063.558997:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1785394063.559008:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2359:x1872120807280000:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.559097:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2359:x1872120807280000:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.559105:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1785394063.559125:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785394063.559131:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2358:x1872120807280384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.559154:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2358:x1872120807280384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.559160:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785394063.559178:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280256 00000100:00100000:1.0:1785394063.559181:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280256 00000100:00100000:1.0:1785394063.559202:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280512 00000100:00100000:1.0:1785394063.559205:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280512 00000100:00100000:1.0:1785394063.559217:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280128 00000100:00100000:1.0:1785394063.559220:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280128 00000100:00100000:1.0:1785394063.559245:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280640 00000100:00100000:2.0:1785394063.559613:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807279872 00000100:00100000:2.0:1785394063.559619:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807279872 00000100:00100000:2.0:1785394063.559654:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:2.0:1785394063.559660:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807279872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394063.559687:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807279872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394063.559704:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1785394063.560450:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280640 00000100:00100000:1.0:1785394063.560477:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394063.560484:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2358:x1872120807280256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.560615:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2358:x1872120807280256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.560623:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394063.560636:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394063.560641:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2358:x1872120807280512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.560663:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2358:x1872120807280512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.560668:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394063.560676:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785394063.560680:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2358:x1872120807280128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.560695:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2358:x1872120807280128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 15us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.560700:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1785394063.560707:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1785394063.560712:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2358:x1872120807280640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394063.560726:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2358:x1872120807280640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 15us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394063.560731:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00080000:1.0:1785394063.560762:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785394063.560765:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785394063.560768:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785394064.351704:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394065.378454:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394066.408514:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394066.486959:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785394066.486988:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831399680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785394066.487069:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394066.487193:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831399680 00000100:00100000:1.0:1785394066.487203:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831399680 00000100:00100000:1.0:1785394066.487291:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785394066.487301:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831399680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785394066.487342:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785394066.487400:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831399680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394066.487406:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1785394066.487456:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785394066.487491:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831399680:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1785394067.297455:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785394067.423721:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785394067.522830:0:16136:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff11c4ff40 20000000:00000080:3.0:1785394067.522853:0:16136:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93abc2b1c800 uarg=0000000000000000 20000000:01000000:3.0:1785394067.522900:0:16136:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1785394067.522907:0:16136:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1785394067.522913:0:16136:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1785394067.537058:0:16137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1785394067.539229:0:16136:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1785394067.550648:0:16136:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785394067.550709:0:16136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.550731:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.550739:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 18 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.550745:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.551298:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 12 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.551308:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.551317:0:16136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.551836:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 12 pid: 14108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.551855:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 12 pid: 14108 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.551874:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831399808:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785394067.552539:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 12 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.552548:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 12 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.552557:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831399936:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785394067.552651:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.552660:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.552684:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400064:0@lo:104: 00000100:00100000:3.0:1785394067.552730:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394067.554687:0:14098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400064 00000100:00100000:0.0:1785394067.554699:0:14098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400064 00000100:00100000:0.0:1785394067.554764:0:14098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785394067.554785:0:14098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:16136:x1872120831400064:12345-0@lo:104: 00010000:00010000:0.0:1785394067.554802:0:14098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.554875:0:14098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785394067.554881:0:14098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:daecb8d0-f73c-4aec-8915-f89616659996+3:16136:x1872120831400064:12345-0@lo:104: Request processed in 109us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394067.554889:0:14098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785394067.555431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394067.555483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394067.555506:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280896 00000100:00100000:1.0:1785394067.555509:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280896 00010000:00010000:1.0:1785394067.555533:0:14101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 13 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.555554:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807280768 00000100:00100000:1.0:1785394067.555556:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807280768 00010000:00010000:1.0:1785394067.555566:0:14101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 14 pid: 14108 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.555600:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1785394067.555607:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+14:2359:x1872120807280896:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.555618:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394067.555623:0:14101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 14 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.555650:0:14101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 14 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.555671:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394067.555701:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf79d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+14:2359:x1872120807280896:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394067.555708:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1785394067.555724:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785394067.555730:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807280768:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.555737:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394067.555741:0:14101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 13 pid: 14108 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.555750:0:14101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 13 pid: 14108 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.555760:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785394067.556149:0:14103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785394067.556157:0:14103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.556166:0:14103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0a00 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:2.0:1785394067.556170:0:14103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.556179:0:14103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785394067.556188:0:14103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785394067.556194:0:14103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785394067.556231:0:14103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.556236:0:14103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785394067.556268:0:14103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.556276:0:14103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ac6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ac73 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.556290:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394067.556293:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394067.556294:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394067.556303:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785394067.556323:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831400192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785394067.556533:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807280768:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 802us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394067.556540:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00010000:00010000:3.0:1785394067.556632:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 18 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.556644:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 18 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.556654:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400320:0@lo:104: 00000100:00100000:2.0:1785394067.563533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394067.563898:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400192 00000100:00100000:1.0:1785394067.563910:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400192 00010000:00010000:1.0:1785394067.563952:0:14102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.564002:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785394067.564012:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7940450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831400192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.564045:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394067.564052:0:14102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.564066:0:14102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.564098:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394067.564158:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7940450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+19:3315:x1872120831400192:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394067.564165:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785394067.564254:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831400192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785394067.566418:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785394067.566479:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.566504:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 18 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.566518:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400448:0@lo:104: 00000100:00100000:3.0:1785394067.566554:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394067.566587:0:16136:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc3e4db40 going to sleep for 11 seconds 00010000:00010000:3.0:1785394067.566610:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d1000/0xcc9b96d8b362add1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda44 expref: 12 pid: 14108 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.566627:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831399808:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785394067.566638:0:14099:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1785394067.566640:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ad007d0e00/0xcc9b96d8b362ad99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dd9e2 expref: 11 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394067.566654:0:14099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400320 00000100:00100000:3.0:1785394067.566655:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831399936:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785394067.566660:0:14099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400320 00010000:00010000:3.0:1785394067.566686:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acd7c59400/0xcc9b96d8b362ac73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362ac6c expref: 18 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394067.566689:0:14099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400448 00000100:00100000:2.0:1785394067.566694:0:14099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400448 00000100:00100000:3.0:1785394067.566699:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400064:0@lo:104: 00000100:00100000:2.0:1785394067.566711:0:14099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785394067.566720:0:14099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+4:16136:x1872120831400320:12345-0@lo:104: 00010000:00010000:2.0:1785394067.566733:0:14099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.566784:0:14099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785394067.566789:0:14099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+4:16136:x1872120831400320:12345-0@lo:104: Request processed in 72us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394067.566795:0:14099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785394067.566809:0:14099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785394067.566815:0:14099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7e97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:16136:x1872120831400448:12345-0@lo:104: 00010000:00010000:2.0:1785394067.566822:0:14099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.566848:0:14099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785394067.566852:0:14099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7e97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:daecb8d0-f73c-4aec-8915-f89616659996+3:16136:x1872120831400448:12345-0@lo:104: Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394067.566857:0:14099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1785394067.567003:0:14104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785394067.567011:0:14104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.567018:0:14104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58600 already unused, calling callback (ffffffffc1d67c20) 00010000:00010000:0.0:1785394067.567020:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1785394067.567024:0:14104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.567028:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.567035:0:14104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.567053:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0600 already unused, calling callback (ffffffffc1d67c20) 10000000:00010000:1.0:1785394067.567054:0:14104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785394067.567060:0:15609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394067.567063:0:14104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1785394067.567084:0:15609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785394067.567092:0:15609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785394067.567098:0:15609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785394067.567102:0:14104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.567119:0:14104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785394067.567119:0:15609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.567135:0:15609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785394067.567141:0:14104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.567146:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.567149:0:14104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acd7c58600/0xcc9b96d8b362ab38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362ab3f expref: -99 pid: 14749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394067.567160:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff93acff9f0600/0xcc9b96d8b362aaeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcc9b96d8b362aaf2 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.567172:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394067.567176:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394067.567178:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394067.567179:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394067.567182:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394067.567184:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394067.567229:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831400704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785394067.567270:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394067.567301:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785394067.567306:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831400576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785394067.567335:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394067.567546:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400320:0@lo:104: 00000100:00100000:3.0:1785394067.567554:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1872120831400448:0@lo:104: 00010000:00010000:3.0:1785394067.567612:0:16136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.568452:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400704 00000100:00100000:1.0:1785394067.568458:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400704 00010000:00010000:1.0:1785394067.568479:0:14102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 18 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.568505:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400576 00000100:00100000:1.0:1785394067.568508:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400576 00010000:00010000:1.0:1785394067.568518:0:14102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 19 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.568539:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785394067.568545:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831400704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.568554:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394067.568558:0:14102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.568566:0:14102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.568599:0:14102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acd7c58400/0xcc9b96d8b362aaf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362aaeb expref: 19 pid: 14109 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.568618:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394067.568655:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+18:3318:x1872120831400704:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394067.568661:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785394067.568676:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785394067.568682:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+17:3318:x1872120831400576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.568689:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394067.568694:0:14102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 17 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.568703:0:14102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 17 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394067.571691:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831400704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785394067.572445:0:14102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acc82ba600/0xcc9b96d8b362ab3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcc9b96d8b362ab38 expref: 17 pid: 14110 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.572469:0:14102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394067.572477:0:14102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572561:0:14102:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572590:0:14102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572612:0:14102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572619:0:14102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572626:0:14102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394067.572631:0:14102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572640:0:14102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572658:0:14102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394067.572675:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785394067.572752:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:daecb8d0-f73c-4aec-8915-f89616659996+16:3318:x1872120831400576:12345-0@lo:103:ldlm_bl.0 Request processed in 4069us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394067.572770:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1785394067.572906:0:16136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.572915:0:16136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394067.572921:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362adfb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394067.575940:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831400576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785394068.000310:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831400960:0@lo:400:kworker.0 00000100:00100000:0.0:1785394068.001291:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394068.001464:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400960 00000100:00100000:3.0:1785394068.001473:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400960 00000100:00100000:3.0:1785394068.001541:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785394068.001551:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831400960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394068.001619:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831400960:12345-0@lo:400:kworker.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.001627:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785394068.001731:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831400832:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.001769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.001854:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831401216:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.001901:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.001939:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401216 00000100:00100000:1.0:1785394068.001943:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401216 00000100:00100000:1.0:1785394068.001970:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785394068.001976:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831401216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.002008:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1872120831401216:12345-0@lo:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394068.002014:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1785394068.002062:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785394068.002255:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831401088:0@lo:400:kworker.0 00000100:00100000:2.0:1785394068.002289:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394068.002462:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831400960:0@lo:400:kworker.0 00000100:00100000:0.0:1785394068.002470:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831401472:0@lo:400:kworker.0 00000100:00100000:0.0:1785394068.002494:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394068.002716:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831400832 00000100:00100000:3.0:1785394068.002720:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831400832 00000100:00100000:3.0:1785394068.002753:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785394068.002759:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:3315:x1872120831400832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785394068.002901:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831401600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785394068.002929:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394068.003417:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+16:3315:x1872120831400832:12345-0@lo:400:kworker.0 Request processed in 656us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.003425:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785394068.003471:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401472 00000100:00100000:2.0:1785394068.003476:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401472 00000100:00100000:2.0:1785394068.003510:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785394068.003517:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831401472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785394068.003556:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1872120831401472:12345-0@lo:400:kworker.0 Request processed in 40us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394068.003563:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1785394068.003846:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785394068.003869:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1872120831401472:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.003981:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401088 00000100:00100000:1.0:1785394068.003986:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401088 00000100:00100000:1.0:1785394068.004024:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785394068.004041:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831401088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785394068.004451:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785394068.004908:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831401088:12345-0@lo:400:kworker.0 Request processed in 876us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394068.004916:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785394068.004953:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:daecb8d0-f73c-4aec-8915-f89616659996:3315:1872120831400832:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.004961:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831401344:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.004987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.005043:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401600 00000100:00100000:1.0:1785394068.005047:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401600 00000100:00100000:1.0:1785394068.005071:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785394068.005077:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831401600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785394068.005109:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785394068.005281:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831401088:0@lo:400:kworker.0 00000100:00100000:3.0:1785394068.006217:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401344 00000100:00100000:3.0:1785394068.006222:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401344 00000100:00100000:3.0:1785394068.006275:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785394068.006283:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831401344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394068.006328:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831401344:12345-0@lo:400:kworker.0 Request processed in 47us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.006335:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785394068.006520:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831401600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1442us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394068.006539:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785394068.006589:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1872120831401216:0@lo:400:kworker.0 00000100:00100000:1.0:1785394068.006618:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831401344:0@lo:400:kworker.0 00000100:00080000:0.0:1785394068.006851:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785394068.007212:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831401600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785394068.448869:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785394068.575649:0:14112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785394068.575658:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acce59a000 from 10 10000000:01000000:2.0:1785394068.575664:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785394068.575725:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394068.575738:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394068.575751:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394068.575782:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785394068.575863:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394068.575931:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.576212:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401728 00000100:00100000:3.0:1785394068.576221:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401728 00000100:00100000:3.0:1785394068.576285:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785394068.576295:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+16:14112:x1872120831401728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394068.576313:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394068.576328:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0c00/0xcc9b96d8b362ae09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ae02 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.576355:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0c00/0xcc9b96d8b362ae09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae02 expref: 17 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.576367:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0c00/0xcc9b96d8b362ae09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae02 expref: 17 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.576377:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0c00, rc 0) 00000100:00100000:3.0:1785394068.576442:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831401728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.576449:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1785394068.576533:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785394068.576556:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae09 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.576565:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ae09 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394068.576655:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.576684:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.576700:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acce588e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.576744:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401856 00000100:00100000:3.0:1785394068.576749:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401856 00000100:00100000:3.0:1785394068.576775:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1785394068.576781:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831401856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394068.577058:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831401856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.577076:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785394068.577256:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.577285:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.577324:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.577349:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acce588e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785394068.577360:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831401984 00000100:00100000:1.0:1785394068.577363:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831401984 00000100:00100000:1.0:1785394068.577389:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785394068.577395:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831401984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.577550:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831401984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394068.577557:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785394068.577619:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831401984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785394068.585093:0:16161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1785394068.585305:0:14112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1785394068.585332:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785394068.585346:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae09 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.585359:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0000/0xcc9b96d8b362ae02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae09 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785394068.585371:0:14112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785394068.585374:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93acc7a88800 from 10 10000000:01000000:1.0:1785394068.585377:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785394068.585419:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.585428:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.585440:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394068.585469:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.585544:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.585608:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acce588e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.587247:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402112 00000100:00100000:3.0:1785394068.587259:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402112 00000100:00100000:3.0:1785394068.587319:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785394068.587329:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+17:14112:x1872120831402112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394068.587346:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394068.587363:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362ae17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ae10 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.587389:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362ae17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae10 expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.587401:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f1800/0xcc9b96d8b362ae17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae10 expref: 18 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.587410:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f1800, rc 0) 00000100:00100000:3.0:1785394068.587461:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.587468:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785394068.587565:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785394068.587601:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae17 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.587611:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ae17 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394068.587679:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.587706:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.587732:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acce588e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.587833:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402240 00000100:00100000:3.0:1785394068.587838:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402240 00000100:00100000:3.0:1785394068.587865:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785394068.587872:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394068.588313:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.588320:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1785394068.592701:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.592764:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.592843:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.592888:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acce588e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785394068.592936:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402368 00000100:00100000:2.0:1785394068.592943:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402368 00000100:00100000:2.0:1785394068.592992:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1785394068.593000:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785394068.593313:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394068.593321:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1785394068.593395:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785394068.594105:0:16162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785394068.595182:0:14112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785394068.595213:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785394068.595225:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae17 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394068.595249:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93abc31b3000/0xcc9b96d8b362ae10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae17 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785394068.595262:0:14112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785394068.595265:0:14112:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93abc19f3000 from 10 10000000:01000000:2.0:1785394068.595268:0:14112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785394068.595299:0:14112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394068.595307:0:14112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394068.595317:0:14112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394068.595334:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785394068.595376:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394068.595397:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acff99d180 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.595510:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402496 00000100:00100000:3.0:1785394068.595517:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402496 00000100:00100000:3.0:1785394068.595551:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1785394068.595558:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+18:14112:x1872120831402496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394068.595590:0:14110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394068.595605:0:14110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0000/0xcc9b96d8b362ae25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcc9b96d8b362ae1e expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.595629:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0000/0xcc9b96d8b362ae25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae1e expref: 19 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.595642:0:14110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0000/0xcc9b96d8b362ae25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcc9b96d8b362ae1e expref: 19 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394068.595651:0:14110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0000, rc 0) 00000100:00100000:3.0:1785394068.595687:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831402496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.595694:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1785394068.595772:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785394068.595788:0:14112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae25 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.595797:0:14112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcc9b96d8b362ae25 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394068.595845:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.595871:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.595892:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace004eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.595980:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402624 00000100:00100000:3.0:1785394068.595991:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402624 00000100:00100000:3.0:1785394068.596019:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1785394068.596025:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831402624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394068.596409:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831402624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.596416:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1785394068.596475:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.596499:0:14112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf960ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394068.596534:0:14112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394068.596560:0:14112:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ace004eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785394068.596626:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402752 00000100:00100000:3.0:1785394068.596630:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402752 00000100:00100000:3.0:1785394068.596649:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785394068.596655:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831402752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785394068.596777:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:14112:x1872120831402752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.596784:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785394068.596896:0:14112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf960ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:daecb8d0-f73c-4aec-8915-f89616659996:14112:1872120831402752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1785394068.605434:0:16163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1785394068.605687:0:14112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1785394068.605722:0:14112:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785394068.605736:0:14112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae25 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394068.605749:0:14112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93ad007d0a00/0xcc9b96d8b362ae1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcc9b96d8b362ae25 expref: -99 pid: 14112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394068.682349:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394068.682395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.682472:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281024 00000100:00100000:3.0:1785394068.682484:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281024 00000100:00100000:1.0:1785394068.682524:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281152 00000100:00100000:1.0:1785394068.682529:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281152 00000100:00100000:3.0:1785394068.682540:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1785394068.682550:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:2360:x1872120807281024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394068.682590:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1785394068.682598:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807281152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394068.682650:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:2360:x1872120807281024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.682696:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00080000:0.0:1785394068.686549:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785394068.686890:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807281152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 4285us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394068.686904:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1785394068.690804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.690879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.696450:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.696483:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281408 00000100:00100000:3.0:1785394068.696494:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281408 00000100:00100000:3.0:1785394068.696555:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281664 00000100:00100000:3.0:1785394068.696558:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281664 00000100:00100000:3.0:1785394068.696599:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281280 00000100:00100000:3.0:1785394068.696602:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281280 00000100:00100000:3.0:1785394068.696621:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1785394068.696632:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2361:x1872120807281408:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1785394068.696707:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785394068.696712:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785394068.696728:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2361:x1872120807281408:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 97us (5935us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.696736:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1785394068.696756:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1785394068.696763:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2361:x1872120807281664:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394068.696799:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2361:x1872120807281664:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (5920us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.696806:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1785394068.696818:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1785394068.696824:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2361:x1872120807281280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394068.696843:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2361:x1872120807281280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.696849:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1785394068.696880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.696949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394068.696961:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281792 00000100:00100000:3.0:1785394068.696964:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281792 00000100:00100000:3.0:1785394068.696984:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1785394068.696989:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2361:x1872120807281792:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394068.697010:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2361:x1872120807281792:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394068.697026:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1785394068.697117:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281536 00000100:00100000:0.0:1785394068.697121:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281536 00000100:00100000:0.0:1785394068.697170:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:0.0:1785394068.697178:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2361:x1872120807281536:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785394068.697214:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2361:x1872120807281536:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394068.697221:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00080000:0.0:1785394068.697246:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785394068.697249:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785394069.382202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394069.384039:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807281920 00000100:00100000:3.0:1785394069.384053:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807281920 00000100:00100000:3.0:1785394069.384204:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:3.0:1785394069.384215:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+11:13718:x1872120807281920:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785394069.384246:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394069.384270:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93acff9f0600/0xcc9b96d8b362ae2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda75 expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394069.384302:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93acff9f0600/0xcc9b96d8b362ae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda75 expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394069.384316:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93acff9f0600/0xcc9b96d8b362ae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda75 expref: 12 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394069.384326:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0600, rc 0) 00000100:00100000:3.0:1785394069.385517:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807281920:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 1301us (3327us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394069.385526:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:2.0:1785394069.398252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394069.398330:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282048 00000100:00100000:3.0:1785394069.398342:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282048 00000100:00100000:3.0:1785394069.398407:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1785394069.398419:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807282048:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785394069.398855:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807282048:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 436us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394069.398864:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1785394069.405545:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394069.405602:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282176 00000100:00100000:0.0:1785394069.405613:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282176 00000100:00100000:0.0:1785394069.405667:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1785394069.405688:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807282176:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785394069.408021:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807282176:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 2326us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394069.408043:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1785394069.420519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394069.420615:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282304 00000100:00100000:1.0:1785394069.420626:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282304 00000100:00100000:1.0:1785394069.420691:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1785394069.420703:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+12:13718:x1872120807282304:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785394069.420726:0:14109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394069.420749:0:14109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93abc31b2800/0xcc9b96d8b362ae33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda7c expref: -99 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394069.420785:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93abc31b2800/0xcc9b96d8b362ae33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda7c expref: 13 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394069.420815:0:14109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93abc31b2800/0xcc9b96d8b362ae33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda7c expref: 13 pid: 14109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394069.420842:0:14109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b2800, rc 0) 00000100:00100000:1.0:1785394069.420903:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13718:x1872120807282304:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 202us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394069.420911:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:2.0:1785394069.430402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394069.431019:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282432 00000100:00100000:1.0:1785394069.431040:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282432 00000100:00100000:1.0:1785394069.431104:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1785394069.431116:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13718:x1872120807282432:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785394069.432566:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13718:x1872120807282432:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 1448us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394069.432604:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1785394069.436803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394069.436843:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282560 00000100:00100000:1.0:1785394069.436853:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282560 00000100:00100000:1.0:1785394069.436903:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1785394069.436913:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13718:x1872120807282560:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785394069.437197:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:13718:x1872120807282560:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 284us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394069.437205:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00010000:00010000:2.0:1785394069.471777:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394070.495836:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785394071.520818:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785394071.584387:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394071.586232:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831402880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785394071.586444:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394071.586691:0:14755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831402880 00000100:00100000:0.0:1785394071.586702:0:14755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831402880 00000100:00080000:2.0:1785394071.586779:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785394071.604206:0:14755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785394071.604244:0:14755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831402880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785394071.606585:0:14755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785394071.606730:0:14755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831402880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2500us (20283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394071.606742:0:14755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785394071.611356:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831402880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785394072.544182:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394073.120051:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831403136:0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120143:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394073.120202:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831403648:0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120242:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394073.120279:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785394073.120287:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831403008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785394073.120315:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394073.120330:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831403520:0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120348:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785394073.120379:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403648 00000100:00100000:0.0:1785394073.120387:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403648 00000100:00100000:0.0:1785394073.120451:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403520 00000100:00100000:0.0:1785394073.120455:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403520 00000100:00100000:0.0:1785394073.120471:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785394073.120495:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831403648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120548:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1872120831403648:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394073.120556:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785394073.120595:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785394073.120602:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831403520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120629:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1872120831403520:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394073.120636:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785394073.120674:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1872120831403520:0@lo:400:kworker.0 00000100:00100000:0.0:1785394073.120685:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1872120831403648:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.120839:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831403264:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.120873:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394073.120900:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831403776:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.120918:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394073.120935:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785394073.120940:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831403392:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.120960:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394073.120988:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403264 00000100:00100000:3.0:1785394073.120992:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403264 00000100:00100000:3.0:1785394073.121022:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403392 00000100:00100000:3.0:1785394073.121025:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403392 00000100:00100000:3.0:1785394073.121042:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785394073.121049:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831403264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.121080:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831403264:12345-0@lo:400:kworker.0 Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.121086:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785394073.121097:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785394073.121103:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831403392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.121123:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1872120831403392:12345-0@lo:400:kworker.0 Request processed in 21us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.121129:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785394073.121144:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403776 00000100:00100000:3.0:1785394073.121153:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403776 00000100:00100000:3.0:1785394073.121172:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785394073.121177:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831403776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.121202:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1872120831403776:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.121219:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785394073.121244:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831403392:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.121254:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1872120831403264:0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.121263:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1872120831403776:0@lo:400:kworker.0 00000100:00080000:2.0:1785394073.121381:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785394073.121386:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785394073.121388:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785394073.122402:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403136 00000100:00100000:3.0:1785394073.122462:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403136 00000100:00100000:3.0:1785394073.122501:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1785394073.122509:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+19:3316:x1872120831403136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394073.122562:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:daecb8d0-f73c-4aec-8915-f89616659996+19:3316:x1872120831403136:12345-0@lo:400:kworker.0 Request processed in 53us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.122585:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1785394073.122644:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831403008 00000100:00100000:3.0:1785394073.122648:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831403008 00000100:00100000:3.0:1785394073.122672:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785394073.122679:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831403008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785394073.122710:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785394073.122746:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1872120831403008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.122754:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785394073.122947:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acff98aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1872120831403008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785394073.122959:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:daecb8d0-f73c-4aec-8915-f89616659996:3316:1872120831403136:0@lo:400:kworker.0 00000100:00100000:2.0:1785394073.410284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.410445:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282688 00000100:00100000:3.0:1785394073.410475:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282688 00000100:00100000:3.0:1785394073.410607:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1785394073.410620:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:14376:x1872120807282688:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785394073.410648:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.410679:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362ae3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda83 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410758:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410774:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410790:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410808:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410815:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.410821:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411465:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b362ae4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411475:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b362ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411483:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b362ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.411606:0:14117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785394073.411611:0:14117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785394073.411709:0:14117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b362ae4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411722:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411728:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411735:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411741:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.411746:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411753:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411766:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:3.0:1785394073.411769:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.411774:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411781:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1e00/0xcc9b96d8b362ae41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411794:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411809:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411815:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411820:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acff9f0a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.411823:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411829:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411836:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93acd8302000) 00010000:00010000:3.0:1785394073.411839:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.411842:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411847:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0a00/0xcc9b96d8b362ae48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411881:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f1000/0xcc9b96d8b362ae3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda83 expref: 8 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411893:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acff9f0800/0xcc9b96d8b362ae4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda83 expref: 7 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.411901:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acd8302700) 00010000:00010000:3.0:1785394073.411904:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785394073.411911:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acff9f0800, rc 0) 00000100:00100000:3.0:1785394073.411979:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:14376:x1872120807282688:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1362us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.411988:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:2.0:1785394073.412925:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785394073.421612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.421704:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807282944 00000100:00100000:3.0:1785394073.421717:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807282944 00000100:00100000:3.0:1785394073.421779:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1785394073.421790:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:14376:x1872120807282944:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785394073.421816:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.421840:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda8a expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421926:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421942:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421954:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421970:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421976:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.421983:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422646:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43200/0xcc9b96d8b362ae6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422665:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43200/0xcc9b96d8b362ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422673:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43200/0xcc9b96d8b362ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.422685:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1785394073.422968:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422976:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422983:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.422989:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.422994:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423001:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423014:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93acd8302700) 00010000:00010000:3.0:1785394073.423017:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.423022:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423029:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362ae5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423041:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423052:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423058:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423063:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.423066:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423071:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423078:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93acd8302500) 00010000:00010000:3.0:1785394073.423081:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.423084:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423089:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423531:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda8a expref: 10 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423547:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43200/0xcc9b96d8b362ae6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda8a expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.423556:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acd8302900) 00010000:00010000:3.0:1785394073.423558:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.423600:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43200, rc 0) 00000100:00100000:3.0:1785394073.423686:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14376:x1872120807282944:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1897us (2118us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1785394073.423696:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1785394073.429478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.429777:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283072 00000100:00100000:0.0:1785394073.429790:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283072 00000100:00100000:0.0:1785394073.429851:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1785394073.429861:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14376:x1872120807283072:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1785394073.429984:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14376:x1872120807283072:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 125us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394073.429992:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000040:00080000:0.0:1785394073.442923:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1785394073.492872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.493014:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283200 00000100:00100000:0.0:1785394073.493028:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283200 00000100:00100000:0.0:1785394073.493112:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1785394073.493122:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14382:x1872120807283200:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1785394073.493149:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394073.493189:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362ae79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda91 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493296:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493313:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493326:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493342:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493350:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493357:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493787:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493796:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493803:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493810:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785394073.493815:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493835:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493850:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:0.0:1785394073.493853:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785394073.493859:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493866:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58000/0xcc9b96d8b362ae80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493879:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493886:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493892:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493898:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785394073.493900:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493906:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493923:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93acd96a4500) 00010000:00010000:0.0:1785394073.493926:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785394073.493930:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493946:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362ae87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493981:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362ae79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda91 expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.493992:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:0.0:1785394073.493995:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785394073.493999:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362ae79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda91 expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.494008:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58800, rc 0) 00000100:00100000:0.0:1785394073.494070:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14382:x1872120807283200:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 950us (1211us total) trans 0 rc 301/301 00000100:00100000:0.0:1785394073.494079:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785394073.518642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.518807:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283328 00000100:00100000:1.0:1785394073.518818:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283328 00000100:00100000:1.0:1785394073.518879:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785394073.518892:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14382:x1872120807283328:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:1.0:1785394073.519009:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14382:x1872120807283328:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394073.519018:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785394073.536924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.537025:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283584 00000100:00100000:3.0:1785394073.537044:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283584 00000100:00100000:3.0:1785394073.537118:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1785394073.537130:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14382:x1872120807283584:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1785394073.537200:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394073.537243:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2200/0xcc9b96d8b362adbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda0c expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.537277:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:3.0:1785394073.537283:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785394073.537639:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.537656:0:14116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 5 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.537666:0:14116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.537708:0:14116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 5 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.537724:0:14116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 5 pid: 14115 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394073.537755:0:14116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14116:1872120831403904:192.168.203.12@tcp:104: 00000100:00100000:3.0:1785394073.537865:0:14116:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc9aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1785394073.540606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394073.540714:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283712 00000100:00100000:2.0:1785394073.540723:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283712 00010000:00010000:2.0:1785394073.540784:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 6 pid: 14115 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394073.540826:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1785394073.540837:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2358:x1872120807283712:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785394073.540852:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785394073.540859:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 6 pid: 14115 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.540874:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 6 pid: 14115 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.540901:0:14100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:2.0:1785394073.540907:0:14100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.540931:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.540940:0:14100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.540961:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785394073.541011:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2358:x1872120807283712:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 176us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394073.541019:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:0.0:1785394073.541151:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785394073.541645:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59800/0xcc9b96d8b362adf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda6e expref: 5 pid: 14115 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394073.541665:0:14116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14116:1872120831403904:192.168.203.12@tcp:104: 00010000:00010000:3.0:1785394073.541689:0:14116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.541700:0:14116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.541707:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.541730:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.541739:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.541748:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.546723:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785394073.546743:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546755:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546773:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546780:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.546786:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546796:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546813:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acc9991700) 00010000:00010000:3.0:1785394073.546817:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394073.546821:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.546829:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785394073.546855:0:14116:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5c58974 reply state 00000000ea665f59 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394073.546866:0:14116:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785394073.546992:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+10:14382:x1872120807283584:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 9859us (10088us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1785394073.547002:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:1.0:1785394073.558763:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558784:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558793:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558799:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.558805:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558813:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558832:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93acd8302500) 00010000:00010000:1.0:1785394073.558836:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.558841:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.558848:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43600/0xcc9b96d8b362ae95 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.567805:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785394073.602190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.602340:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283840 00000100:00100000:3.0:1785394073.602353:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283840 00000100:00100000:3.0:1785394073.602425:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1785394073.602436:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:14390:x1872120807283840:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:3.0:1785394073.602489:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.602517:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda98 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602651:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362aea3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602668:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362aea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602680:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362aea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.602750:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785394073.602754:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1785394073.602796:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362aea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602821:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362ae9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda98 expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602841:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42800/0xcc9b96d8b362aea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda98 expref: 10 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.602850:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:3.0:1785394073.602853:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785394073.602857:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42800, rc 0) 00000100:00100000:3.0:1785394073.603449:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+10:14390:x1872120807283840:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 1012us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.603457:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1785394073.650520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.650615:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807283968 00000100:00100000:3.0:1785394073.650629:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807283968 00000100:00100000:3.0:1785394073.651073:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785394073.651087:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:14391:x1872120807283968:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785394073.651115:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.651142:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362aeaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7dda9f expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651236:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b362aeb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651313:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b362aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651327:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b362aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.651400:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785394073.651405:0:14116:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1785394073.651434:0:14116:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b362aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651463:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362aeaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda9f expref: 7 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651485:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43800/0xcc9b96d8b362aeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7dda9f expref: 6 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.651495:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:3.0:1785394073.651498:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785394073.651520:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43800, rc 0) 00000100:00100000:3.0:1785394073.651741:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:14391:x1872120807283968:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 657us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.651751:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1785394073.658647:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.658937:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807284096 00000100:00100000:1.0:1785394073.658949:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807284096 00000100:00100000:1.0:1785394073.659031:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1785394073.659044:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+6:14391:x1872120807284096:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785394073.659070:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394073.659096:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362aeb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddaa6 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659169:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659186:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659200:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659226:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659233:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659239:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659333:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659341:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659365:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394073.659429:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1785394073.659434:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785394073.659460:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659472:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659478:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659485:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659491:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.659495:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659501:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659512:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785394073.659515:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.659518:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659524:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659547:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659553:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659558:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659564:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.659598:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659604:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659613:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93acc9991e00) 00010000:00010000:1.0:1785394073.659615:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.659618:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659624:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659658:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362aeb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaa6 expref: 8 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659775:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaa6 expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.659794:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acc9991100) 00010000:00010000:1.0:1785394073.659797:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785394073.659799:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b2400, rc 0) 00000100:00100000:1.0:1785394073.659858:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+7:14391:x1872120807284096:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 817us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394073.659865:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1785394073.673312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.673411:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807284352 00000100:00100000:3.0:1785394073.673420:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807284352 00000100:00100000:3.0:1785394073.673486:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1785394073.673497:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+7:14391:x1872120807284352:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785394073.673517:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.673535:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362aed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddaad expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.673687:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785394073.673795:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362aed4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaad expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.673809:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:3.0:1785394073.673811:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785394073.673816:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362aed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaad expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.673829:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43c00, rc 0) 00000100:00100000:3.0:1785394073.673879:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+8:14391:x1872120807284352:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 384us (577us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1785394073.673886:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1785394073.680115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.680220:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807284608 00000100:00100000:0.0:1785394073.680229:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807284608 00000100:00100000:0.0:1785394073.680284:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785394073.680293:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+8:14391:x1872120807284608:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1785394073.680344:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785394073.680369:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2400/0xcc9b96d8b362aecd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaa6 expref: 8 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.680389:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acc9991100) 00010000:00010000:0.0:1785394073.680401:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785394073.680446:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.680459:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.680469:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785394073.680820:0:14117:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e3ca004 reply state 0000000039930bf5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394073.680830:0:14117:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1785394073.680843:0:14117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1785394073.680920:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+9:14391:x1872120807284608:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 627us (813us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1785394073.680927:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1785394073.687421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394073.687514:0:14119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807284864 00000100:00100000:2.0:1785394073.687523:0:14119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807284864 00000100:00100000:2.0:1785394073.687596:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1785394073.687606:0:14119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+9:14391:x1872120807284864:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1785394073.687921:0:14119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+10:14391:x1872120807284864:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 312us (504us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1785394073.687932:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00010000:00010000:3.0:1785394073.688787:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688815:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688823:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688829:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394073.688834:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688842:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688857:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd96a4500) 00010000:00010000:3.0:1785394073.688860:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1785394073.688864:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.688870:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58c00/0xcc9b96d8b362aee2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394073.700730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.701218:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285120 00000100:00100000:1.0:1785394073.701227:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285120 00000100:00100000:1.0:1785394073.701288:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1785394073.701298:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+9:14391:x1872120807285120:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1785394073.701320:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394073.701338:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362aee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddab4 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701400:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701412:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701423:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701436:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701443:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701466:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394073.701794:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1785394073.701876:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701884:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701890:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701896:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.701900:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701907:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701919:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785394073.701922:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.701927:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701932:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362aef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701945:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701962:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701968:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701973:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.701976:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701982:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.701991:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93acc9991e00) 00010000:00010000:1.0:1785394073.701993:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.701996:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.702002:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362aef7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.703733:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362aee9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddab4 expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.703756:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785394073.703758:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785394073.703765:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362aee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddab4 expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.703793:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3200, rc 0) 00000100:00100000:1.0:1785394073.703846:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+10:14391:x1872120807285120:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2550us (3126us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1785394073.703854:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1785394073.711044:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.711134:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285248 00000100:00100000:3.0:1785394073.711143:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285248 00000100:00100000:3.0:1785394073.711191:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1785394073.711208:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+10:14391:x1872120807285248:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785394073.711232:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.711254:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362af05 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddabb expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711334:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711358:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711370:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.711412:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1785394073.711416:0:14116:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785394073.711433:0:14116:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711456:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43c00/0xcc9b96d8b362af05 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711471:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.711480:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd8302100) 00010000:00010000:3.0:1785394073.711483:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785394073.711486:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42000, rc 0) 00000100:00100000:3.0:1785394073.711541:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+11:14391:x1872120807285248:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 342us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.711547:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:3.0:1785394073.715071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394073.715123:0:14119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285376 00000100:00100000:2.0:1785394073.715131:0:14119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285376 00000100:00100000:2.0:1785394073.715173:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1785394073.715182:0:14119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+11:14391:x1872120807285376:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1785394073.730084:0:14119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+11:14391:x1872120807285376:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 14893us (15016us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394073.730105:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1785394073.732694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.732863:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285632 00000100:00100000:1.0:1785394073.732875:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285632 00000100:00100000:1.0:1785394073.732948:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1785394073.732962:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc83fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+11:14391:x1872120807285632:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785394073.733277:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc83fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01dc2679-0e90-4bb5-beb6-6fa722754450+12:14391:x1872120807285632:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 317us (590us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1785394073.733287:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1785394073.788847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.788966:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285760 00000100:00100000:1.0:1785394073.788975:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285760 00000100:00100000:1.0:1785394073.789034:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1785394073.789043:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+10:14397:x1872120807285760:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1785394073.789062:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394073.789081:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362af13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddac2 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789138:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789152:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789163:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789192:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789210:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789219:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789321:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3e00/0xcc9b96d8b362af28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789329:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3e00/0xcc9b96d8b362af28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789335:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3e00/0xcc9b96d8b362af28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394073.789370:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1785394073.789393:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785394073.789452:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3e00/0xcc9b96d8b362af28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789469:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789477:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789485:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789509:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.789515:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789524:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789541:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:1.0:1785394073.789545:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.789550:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789557:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362af1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789617:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789624:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789628:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789633:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.789635:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789640:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789659:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93acc9991e00) 00010000:00010000:1.0:1785394073.789670:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.789674:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789679:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362af21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789717:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362af13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac2 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789728:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3e00/0xcc9b96d8b362af28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac2 expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.789735:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd8302100) 00010000:00010000:1.0:1785394073.789737:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785394073.789739:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3e00, rc 0) 00000100:00100000:1.0:1785394073.789791:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+11:14397:x1872120807285760:12345-192.168.203.12@tcp:101:bash.0 Request processed in 750us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394073.789799:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1785394073.797218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.797261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.797291:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.797324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.797364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.797392:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286144 00000100:00100000:0.0:1785394073.797400:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286144 00000100:00100000:0.0:1785394073.797447:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286400 00000100:00100000:0.0:1785394073.797451:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286400 00000100:00100000:0.0:1785394073.797464:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286016 00000100:00100000:0.0:1785394073.797466:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286016 00000100:00100000:0.0:1785394073.797491:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286272 00000100:00100000:0.0:1785394073.797494:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286272 00000100:00100000:0.0:1785394073.797507:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1785394073.797515:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807286144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1785394073.797609:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807286144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394073.797617:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1785394073.797633:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1785394073.797640:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2359:x1872120807286400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394073.797759:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1785394073.797768:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807286016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394073.797794:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807286016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394073.797800:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1785394073.797813:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1785394073.797818:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2359:x1872120807286272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394073.797836:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2359:x1872120807286272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 18us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394073.797842:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00080000:3.0:1785394073.797921:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785394073.797925:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785394073.798086:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807285888 00000100:00100000:1.0:1785394073.798090:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807285888 00000100:00100000:1.0:1785394073.798124:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1785394073.798131:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807285888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1785394073.798183:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807285888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 51us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394073.798190:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1785394073.798365:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2359:x1872120807286400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394073.798372:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1785394073.802360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394073.802513:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286656 00000100:00100000:2.0:1785394073.802524:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286656 00000100:00100000:2.0:1785394073.802640:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1785394073.802655:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+11:14397:x1872120807286656:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1785394073.802697:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394073.802718:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362af2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddac9 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.802832:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.802846:0:14117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.802873:0:14117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.802904:0:14117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394073.802917:0:14117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 11 pid: 14116 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394073.802930:0:14117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404032:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785394073.803006:0:14117:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf957acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785394073.807870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394073.807903:0:14117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404032:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785394073.807937:0:14117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394073.807980:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286784 00000100:00100000:1.0:1785394073.807992:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286784 00010000:00010000:1.0:1785394073.808044:0:14101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 12 pid: 14116 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394073.808147:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1785394073.808158:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+12:2358:x1872120807286784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785394073.808175:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394073.808183:0:14101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 12 pid: 14116 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808198:0:14101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 12 pid: 14116 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808234:0:14101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42000/0xcc9b96d8b362af0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddabb expref: 12 pid: 14116 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808254:0:14101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd8302100) 00010000:00010000:1.0:1785394073.808260:0:14101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808271:0:14101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808281:0:14101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.808309:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785394073.808353:0:14117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.808364:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394073.808374:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+11:2358:x1872120807286784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 213us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394073.808399:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:0.0:1785394073.808410:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.808425:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.808454:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811000:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811016:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811027:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785394073.811037:0:14117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1785394073.811064:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811072:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811078:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811084:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:0.0:1785394073.811088:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811095:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811107:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd8302100) 00010000:00010000:0.0:1785394073.811110:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785394073.811120:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811126:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362af36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785394073.811140:0:14117:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010182157 reply state 00000000ae5036d0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394073.811149:0:14117:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785394073.811184:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362af2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 14 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811199:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 13 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394073.811215:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:0.0:1785394073.811218:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1785394073.811220:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58400, rc 0) 00000100:00100000:0.0:1785394073.811299:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14397:x1872120807286656:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8647us (8945us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1785394073.811307:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:1.0:1785394073.819118:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819133:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819140:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819146:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c59400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394073.819150:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819158:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819173:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93acd96a4900) 00010000:00010000:1.0:1785394073.819176:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785394073.819180:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394073.819185:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c59400/0xcc9b96d8b362af3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394073.824007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394073.824096:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807286912 00000100:00100000:3.0:1785394073.824119:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807286912 00000100:00100000:3.0:1785394073.824174:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1785394073.824185:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+13:14397:x1872120807286912:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1785394073.824224:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.824243:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddad0 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824304:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824317:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824329:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.824365:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1785394073.824369:0:14116:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785394073.824390:0:14116:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824399:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824422:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 15 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824438:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 14 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.824447:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394073.824455:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785394073.824459:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42200, rc 0) 00000100:00100000:3.0:1785394073.824520:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14397:x1872120807286912:12345-192.168.203.12@tcp:101:bash.0 Request processed in 336us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394073.824527:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1785394073.830434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.830564:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807287168 00000100:00100000:1.0:1785394073.830605:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807287168 00000100:00100000:1.0:1785394073.830670:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1785394073.830680:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14397:x1872120807287168:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1785394073.830994:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+15:14397:x1872120807287168:12345-192.168.203.12@tcp:35:bash.0 Request processed in 314us (567us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1785394073.831002:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1785394073.902395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394073.902509:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807287424 00000100:00100000:2.0:1785394073.902521:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807287424 00000100:00100000:3.0:1785394073.902680:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1785394073.902708:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+15:14407:x1872120807287424:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785394073.902736:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394073.902756:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddad7 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394073.902861:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785394073.902978:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad7 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.902992:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93acd8302000) 00010000:00010000:3.0:1785394073.902995:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785394073.903000:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad7 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394073.903015:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42e00, rc 0) 00000100:00100000:3.0:1785394073.903099:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+16:14407:x1872120807287424:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 403us (713us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1785394073.903109:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1785394073.913006:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394073.913265:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807287680 00000100:00100000:1.0:1785394073.913274:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807287680 00000100:00100000:1.0:1785394073.913326:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1785394073.913335:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+16:14407:x1872120807287680:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1785394073.913564:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+17:14407:x1872120807287680:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 229us (566us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1785394073.914280:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785394074.000340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.000489:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807287936 00000100:00100000:1.0:1785394074.000501:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807287936 00000100:00100000:1.0:1785394074.000608:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1785394074.004466:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+17:14410:x1872120807287936:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1785394074.004496:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394074.004529:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddade expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.004648:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.004662:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.004677:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394074.004687:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1785394074.004830:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362af6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddade expref: 20 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.004857:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddade expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.004866:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.004869:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785394074.004872:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43e00, rc 0) 00000100:00100000:3.0:1785394074.004951:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14410:x1872120807287936:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 4268us (4622us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1785394074.004963:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1785394074.007792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.008485:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807288064 00000100:00100000:3.0:1785394074.008496:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807288064 00000100:00100000:3.0:1785394074.008561:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1785394074.008602:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14410:x1872120807288064:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1785394074.008677:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008693:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008705:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008729:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008736:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008742:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008748:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42600 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394074.008752:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008758:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008769:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.008773:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785394074.008776:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.008781:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394074.008871:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14410:x1872120807288064:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 300us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394074.008878:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1785394074.008902:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.009107:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807288192 00000100:00100000:3.0:1785394074.009115:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807288192 00000100:00100000:3.0:1785394074.009169:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1785394074.009178:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:2360:x1872120807288192:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785394074.009206:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394074.009229:0:14102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddade expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.009248:0:14102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.009253:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394074.009299:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+18:2360:x1872120807288192:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394074.009306:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785394074.010897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.011100:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807288448 00000100:00100000:3.0:1785394074.011109:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807288448 00000100:00100000:3.0:1785394074.011156:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1785394074.011166:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+18:14410:x1872120807288448:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1785394074.011480:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14410:x1872120807288448:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 314us (586us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1785394074.011488:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00010000:00010000:2.0:1785394074.592058:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394074.665556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.665911:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807288704 00000100:00100000:3.0:1785394074.665930:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807288704 00000100:00100000:3.0:1785394074.666021:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1785394074.666038:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14441:x1872120807288704:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1785394074.666260:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785394074.666288:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af8a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddae5 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.666412:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.666428:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.666442:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785394074.666455:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1785394074.666770:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43e00/0xcc9b96d8b362af8a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddae5 expref: 22 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.666794:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddae5 expref: 21 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.666804:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.666807:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785394074.666810:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d42600, rc 0) 00000100:00100000:3.0:1785394074.666983:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:14441:x1872120807288704:12345-192.168.203.12@tcp:101:cat.0 Request processed in 946us (1440us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1785394074.666991:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1785394074.679136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394074.679250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.679402:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289088 00000100:00100000:3.0:1785394074.679426:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289088 00000100:00100000:3.0:1785394074.679493:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1785394074.679504:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:14441:x1872120807289088:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1785394074.679987:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+22:14441:x1872120807289088:12345-192.168.203.12@tcp:35:cat.0 Request processed in 483us (735us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1785394074.679996:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1785394074.680045:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807288832 00000100:00100000:2.0:1785394074.680060:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807288832 00000100:00100000:2.0:1785394074.680137:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1785394074.680146:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+22:2360:x1872120807288832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785394074.680160:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785394074.680183:0:14100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42600/0xcc9b96d8b362af91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddae5 expref: 22 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.680214:0:14100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:2.0:1785394074.680231:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785394074.680277:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:2360:x1872120807288832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 132us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394074.680284:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785394074.747477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394074.747655:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289344 00000100:00100000:2.0:1785394074.747667:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289344 00000100:00100000:2.0:1785394074.747732:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1785394074.747744:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:14447:x1872120807289344:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1785394074.747781:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394074.747809:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362af9f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddaec expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.747930:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.747947:0:14117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.747956:0:14117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 22 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.747964:0:14117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.748003:0:14117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 22 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.748018:0:14117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 22 pid: 14116 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394074.748068:0:14117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404160:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785394074.748176:0:14117:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.748186:0:14117:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394074.748204:0:14117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404288:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785394074.748229:0:14117:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acf957a780 going to sleep for 11 seconds 00000100:00100000:2.0:1785394074.752303:0:14117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404160:192.168.203.12@tcp:104: 00000100:00100000:2.0:1785394074.752323:0:14117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93abc3b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14117:1872120831404288:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785394074.752351:0:14117:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394074.753269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.754548:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289472 00000100:00100000:1.0:1785394074.754558:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289472 00010000:00010000:1.0:1785394074.754703:0:14101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 23 pid: 14116 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394074.754746:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1785394074.754757:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7940050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:2361:x1872120807289472:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785394074.754775:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394074.754783:0:14101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 23 pid: 14116 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.754811:0:14101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 23 pid: 14116 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.754838:0:14101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362af59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddad0 expref: 23 pid: 14116 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.754858:0:14101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785394074.754864:0:14101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.754873:0:14101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.754880:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394074.760289:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7940050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+22:2361:x1872120807289472:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5516us (7005us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394074.760307:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1785394074.763032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.763297:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289600 00000100:00100000:3.0:1785394074.763308:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289600 00010000:00010000:3.0:1785394074.763356:0:14102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394074.763401:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1785394074.763412:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+22:2359:x1872120807289600:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785394074.763428:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394074.763436:0:14102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763452:0:14102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763477:0:14102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362af44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddac9 expref: 22 pid: 14117 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763495:0:14102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.763501:0:14102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763533:0:14102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763542:0:14102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.763599:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394074.763715:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:2359:x1872120807289600:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 304us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394074.763722:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:1.0:1785394074.763871:0:14117:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.763881:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394074.763902:0:14117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1785394074.764119:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362af9f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaec expref: 22 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.764137:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1000/0xcc9b96d8b362afa6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaec expref: 21 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.764152:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785394074.764155:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785394074.764158:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1000, rc 0) 00000100:00100000:1.0:1785394074.764187:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:14447:x1872120807289344:12345-192.168.203.12@tcp:101:dd.0 Request processed in 16446us (16726us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1785394074.764201:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1785394074.793369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394074.793472:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289856 00000100:00100000:3.0:1785394074.793483:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289856 00000100:00100000:3.0:1785394074.793549:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1785394074.793560:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:14447:x1872120807289856:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1785394074.794002:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.794022:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.794035:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785394074.794100:0:14115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1785394074.794139:0:14115:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bba24ad1 reply state 0000000068a115ca transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394074.794149:0:14115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785394074.794263:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14447:x1872120807289856:12345-192.168.203.12@tcp:36:dd.0 Request processed in 703us (906us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1785394074.794289:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000020:00080000:3.0:1785394074.794295:0:14115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1785394074.814353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.814505:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807289984 00000100:00100000:1.0:1785394074.814516:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807289984 00000100:00100000:2.0:1785394074.814690:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1785394074.814704:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14447:x1872120807289984:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1785394074.814730:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394074.814758:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362afbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddaf3 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.814831:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362afbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaf3 expref: 25 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.814867:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362afbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaf3 expref: 25 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394074.814890:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:2.0:1785394074.814893:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785394074.814897:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1600, rc 0) 00000100:00100000:2.0:1785394074.814971:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14447:x1872120807289984:12345-192.168.203.12@tcp:101:dd.0 Request processed in 256us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394074.814978:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00010000:00010000:3.0:1785394074.816360:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816372:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816380:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816386:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394074.816392:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816399:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816414:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394074.816417:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394074.816421:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394074.816427:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362afb4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394074.843022:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.843310:0:14101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290240 00000100:00100000:1.0:1785394074.843323:0:14101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290240 00000100:00100000:1.0:1785394074.843405:0:14101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1785394074.843417:0:14101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14447:x1872120807290240:12345-192.168.203.12@tcp:103:dd.0 00010000:00010000:1.0:1785394074.843434:0:14101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785394074.843463:0:14101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1600/0xcc9b96d8b362afbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddaf3 expref: 24 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.843487:0:14101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785394074.843492:0:14101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785394074.843557:0:14101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:14447:x1872120807290240:12345-192.168.203.12@tcp:103:dd.0 Request processed in 142us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394074.843564:0:14101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1785394074.846378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.846688:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290368 00000100:00100000:1.0:1785394074.846697:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290368 00000100:00100000:1.0:1785394074.846747:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1785394074.846756:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:14447:x1872120807290368:12345-192.168.203.12@tcp:58:dd.0 00010000:00010000:1.0:1785394074.846901:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.846919:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.846932:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785394074.848564:0:14116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785394074.849380:0:14116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1785394074.849451:0:14116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1785394074.849602:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:14447:x1872120807290368:12345-192.168.203.12@tcp:58:dd.0 Request processed in 2842us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394074.851355:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:2.0:1785394074.878966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394074.879187:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290496 00000100:00100000:1.0:1785394074.879207:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290496 00000100:00100000:1.0:1785394074.879276:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1785394074.879288:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:14447:x1872120807290496:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1785394074.879315:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394074.879341:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddafa expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879411:0:14117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879422:0:14117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 24 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879444:0:14117:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879477:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 24 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879493:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785394074.879496:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785394074.879500:0:14117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 24 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394074.879508:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3200, rc 0) 00000100:00100000:1.0:1785394074.879565:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14447:x1872120807290496:12345-192.168.203.12@tcp:101:dd.0 Request processed in 280us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394074.879778:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000040:00080000:0.0:1785394075.490612:0:14149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1785394075.490623:0:14149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785394075.490666:0:14149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1785394075.490679:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1785394075.490852:0:14149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14149:1872120831404416:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785394075.491034:0:14149:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd0525480 going to sleep for 11 seconds 00000100:00100000:2.0:1785394075.506283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.506520:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290624 00000100:00100000:3.0:1785394075.506530:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290624 00000100:00100000:3.0:1785394075.506639:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1785394075.506650:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807290624:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1785394075.506751:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93abc3b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807290624:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 103us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.506760:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00080000:0.0:1785394075.506834:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785394075.510310:0:14149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acc8489c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14149:1872120831404416:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785394075.514264:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.514373:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290752 00000100:00100000:1.0:1785394075.514385:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290752 00000100:00100000:1.0:1785394075.514464:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1785394075.514475:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14449:x1872120807290752:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785394075.514524:0:14116:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785394075.514997:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14449:x1872120807290752:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 522us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394075.515006:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1785394075.524794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.525366:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807290880 00000100:00100000:2.0:1785394075.525379:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807290880 00000100:00100000:2.0:1785394075.525444:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1785394075.525454:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14449:x1872120807290880:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.525560:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525614:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525629:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525646:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525653:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525676:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525713:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525724:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525730:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785394075.525777:0:14115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785394075.525781:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785394075.525797:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525809:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525815:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525822:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525827:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785394075.525831:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525839:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525859:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acd8302900) 00010000:00010000:2.0:1785394075.525862:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785394075.525867:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525873:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362afd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525888:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525894:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525899:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525903:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785394075.525906:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525910:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525926:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.525929:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785394075.525931:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525937:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362afd7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525960:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525966:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525971:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525975:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785394075.525978:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525983:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525989:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:2.0:1785394075.525991:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785394075.525994:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.525999:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362afde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394075.526092:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14449:x1872120807290880:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 638us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.526099:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1785394075.529385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.529501:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807291136 00000100:00100000:1.0:1785394075.529512:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807291136 00000100:00100000:1.0:1785394075.529596:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1785394075.529627:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:14449:x1872120807291136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785394075.529649:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394075.529671:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362afe5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb01 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529784:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529801:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529815:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785394075.529828:0:14116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1785394075.529966:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529974:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529981:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.529988:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:1.0:1785394075.529992:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530000:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530014:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:1.0:1785394075.530023:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785394075.530030:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530036:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3400/0xcc9b96d8b362afec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530087:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362afe5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb01 expref: 26 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530099:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93acd8302900) 00010000:00010000:1.0:1785394075.530102:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785394075.530107:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362afe5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb01 expref: 26 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.530117:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3a00, rc 0) 00000100:00100000:1.0:1785394075.530293:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acff98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807291136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 669us (924us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1785394075.530301:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1785394075.543794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.543871:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807291264 00000100:00100000:1.0:1785394075.543883:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807291264 00000100:00100000:1.0:1785394075.543950:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1785394075.543960:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ad003ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807291264:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785394075.544004:0:14117:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785394075.544387:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ad003ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807291264:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 171us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394075.544396:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1785394075.555739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.555868:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807291520 00000100:00100000:2.0:1785394075.555881:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807291520 00000100:00100000:2.0:1785394075.555963:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1785394075.555974:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:14449:x1872120807291520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.556000:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394075.556026:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362affa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb08 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785394075.557055:0:14115:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1785394075.557064:0:14115:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1785394075.557116:0:14115:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1785394075.560519:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b362b001 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.560542:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b362b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.560556:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b362b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.560660:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1e00/0xcc9b96d8b362affa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb08 expref: 28 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.560683:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b362b001 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb08 expref: 27 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.560693:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acd8302f00) 00010000:00010000:3.0:1785394075.560697:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785394075.560701:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ace2d43400, rc 0) 00000100:00100000:3.0:1785394075.560792:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+27:14449:x1872120807291520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4818us (5065us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1785394075.560802:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1785394075.577441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.577557:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807291776 00000100:00100000:3.0:1785394075.577607:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807291776 00000100:00100000:3.0:1785394075.577698:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1785394075.577709:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+27:14449:x1872120807291776:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785394075.577782:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394075.577817:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43400/0xcc9b96d8b362b001 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb08 expref: 27 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577840:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acd8302f00) 00010000:00010000:3.0:1785394075.577853:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785394075.577881:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577898:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577908:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577936:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577944:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.577951:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578054:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578062:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578294:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578301:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d43000 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.578306:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578315:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578324:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93acd8302100) 00010000:00010000:3.0:1785394075.578328:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394075.578331:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578338:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d43000/0xcc9b96d8b362b00f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578348:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578355:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578361:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578366:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42e00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.578369:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578385:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578393:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x743f062b (ffff93acd8302300) 00010000:00010000:3.0:1785394075.578395:0:14116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394075.578398:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.578404:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42e00/0xcc9b96d8b362b016 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743f062b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394075.578494:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+26:14449:x1872120807291776:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 786us (1066us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785394075.578502:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1785394075.590435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.593400:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807291904 00000100:00100000:3.0:1785394075.593416:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807291904 00000100:00100000:2.0:1785394075.596386:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1785394075.596401:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+26:14449:x1872120807291904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.596428:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394075.596457:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b01d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb0f expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596502:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362b024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596518:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596532:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596756:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b01d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb0f expref: 28 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596778:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0200/0xcc9b96d8b362b024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb0f expref: 27 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.596795:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.596798:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785394075.596802:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d0200, rc 0) 00000100:00100000:2.0:1785394075.596929:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc848a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+27:14449:x1872120807291904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 531us (6509us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.596937:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1785394075.608556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.609148:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807292160 00000100:00100000:1.0:1785394075.609178:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807292160 00000100:00100000:1.0:1785394075.609330:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1785394075.609343:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+27:14449:x1872120807292160:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785394075.609461:0:14117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.609626:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.609642:0:14117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785394075.610125:0:14117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1785394075.610138:0:14117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 607641566550ns, next at 608641563261ns, rc = 0 00000004:00010000:1.0:1785394075.610471:0:14117:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039a99ae7 reply state 00000000758c1220 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394075.610483:0:14117:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785394075.610624:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+29:14449:x1872120807292160:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1283us (2081us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1785394075.610633:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00010000:00010000:2.0:1785394075.616812:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616833:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616841:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616849:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b3a00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:2.0:1785394075.616854:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616863:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616884:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.616888:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785394075.616894:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.616900:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3a00/0xcc9b96d8b362b02b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.617139:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785394075.621864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.625327:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807292288 00000100:00100000:2.0:1785394075.625346:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807292288 00000100:00100000:2.0:1785394075.625502:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1785394075.625515:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+28:14449:x1872120807292288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.625546:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394075.625603:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb16 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.625684:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 29 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.625701:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 29 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.625723:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.625726:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785394075.625730:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1c00, rc 0) 00000100:00100000:2.0:1785394075.625806:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+29:14449:x1872120807292288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 293us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.625814:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1785394075.631474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.631617:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807292416 00000100:00100000:3.0:1785394075.631630:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807292416 00000100:00100000:3.0:1785394075.631702:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785394075.631713:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807292416:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1785394075.632206:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2359:x1872120807292416:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 493us (743us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1785394075.632215:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:0.0:1785394075.632356:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785394075.641818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.642044:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807292672 00000100:00100000:3.0:1785394075.642057:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807292672 00000100:00100000:3.0:1785394075.642221:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1785394075.642335:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+29:14449:x1872120807292672:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785394075.642989:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+30:14449:x1872120807292672:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 756us (1183us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1785394075.642998:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1785394075.648783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.648875:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807292928 00000100:00100000:3.0:1785394075.648886:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807292928 00000100:00100000:3.0:1785394075.648956:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1785394075.648967:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+30:14449:x1872120807292928:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785394075.649093:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+30:14449:x1872120807292928:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.649101:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1785394075.652930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.653058:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293056 00000100:00100000:2.0:1785394075.653075:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293056 00000100:00100000:2.0:1785394075.653141:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1785394075.653152:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+30:14449:x1872120807293056:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.653173:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785394075.653401:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b039 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb1d expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.653483:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.653500:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.653513:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785394075.653557:0:14115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785394075.654137:0:14115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.654170:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b039 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb1d expref: 32 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.654211:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb1d expref: 31 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.654221:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.654225:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785394075.654355:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ad007d1400, rc 0) 00000100:00100000:2.0:1785394075.654464:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+31:14449:x1872120807293056:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1313us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.654473:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1785394075.662893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.662977:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293184 00000100:00100000:1.0:1785394075.662988:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293184 00000100:00100000:1.0:1785394075.663057:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1785394075.663074:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+6:2360:x1872120807293184:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785394075.663097:0:14751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785394075.663124:0:14751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb24 expref: -99 pid: 14751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785394075.663177:0:14751:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6af39a, blocks: 0x1 00010000:00010000:1.0:1785394075.663213:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1785394075.663219:0:14751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394075.663420:0:14751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 7 pid: 14751 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.663447:0:14751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 7 pid: 14751 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394075.663461:0:14751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93abc31b3400, rc 0) 00000100:00100000:1.0:1785394075.663536:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc8488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2360:x1872120807293184:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 469us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394075.663545:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1785394075.665808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394075.666708:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293440 00000100:00100000:1.0:1785394075.666718:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293440 00000100:00100000:1.0:1785394075.666780:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1785394075.666791:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+31:14449:x1872120807293440:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785394075.666908:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+31:14449:x1872120807293440:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 119us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394075.666916:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1785394075.670218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.670344:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293568 00000100:00100000:2.0:1785394075.670371:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293568 00000100:00100000:2.0:1785394075.670427:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1785394075.670438:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+31:14449:x1872120807293568:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1785394075.787834:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:2.0:1785394075.787853:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1785394075.787875:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1785394075.787880:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1785394075.787906:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1785394075.787937:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1785394075.788320:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831404544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1785394075.788405:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394075.788498:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831404544 00000100:00100000:3.0:1785394075.788507:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831404544 00000100:00100000:3.0:1785394075.788590:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785394075.788601:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831404544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1785394075.788771:0:14753:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1785394075.788775:0:14753:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1785394075.788778:0:14753:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1785394075.788780:0:14753:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785394074 -> 1785394074 00002000:00010000:3.0:1785394075.788783:0:14753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1785394075.788820:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1872120831404544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (414us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1785394075.788829:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1785394075.788851:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1785394075.788899:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ad003c8700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1785394075.788905:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ad003c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831404544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1785394075.790229:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14449:x1872120807293568:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 119786us (120014us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.790242:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1785394075.792275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.792608:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293696 00000100:00100000:3.0:1785394075.792620:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293696 00000100:00100000:3.0:1785394075.792668:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1785394075.792678:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2359:x1872120807293696:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1785394075.792800:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2359:x1872120807293696:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 122us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.792807:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1785394075.797128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.797330:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807293952 00000100:00100000:2.0:1785394075.797343:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807293952 00000100:00100000:2.0:1785394075.797418:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1785394075.797430:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14449:x1872120807293952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785394075.797499:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785394075.797534:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1400/0xcc9b96d8b362b040 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb1d expref: 14 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.797561:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:2.0:1785394075.797620:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785394075.797660:0:14116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.797676:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.797687:0:14116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785394075.799128:0:14116:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000185a542 reply state 00000000580840d3 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394075.799144:0:14116:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785394075.799344:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+15:14449:x1872120807293952:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1913us (2225us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1785394075.799354:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1785394075.805082:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1785394075.805160:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805175:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805184:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805200:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.805207:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805215:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805235:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:3.0:1785394075.805238:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394075.805244:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.805268:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d0c00/0xcc9b96d8b362b04e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.807364:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294080 00000100:00100000:0.0:1785394075.807380:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294080 00000100:00100000:0.0:1785394075.807456:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1785394075.807468:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:14449:x1872120807294080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785394075.807493:0:14753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785394075.807517:0:14753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe73eab26dd7ddb2b expref: -99 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.807590:0:14753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.807600:0:14753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394075.807605:0:14753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394075.807611:0:14753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.807651:0:14753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.807666:0:14753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.807682:0:14753:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14753:1872120831404672:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785394075.808498:0:14753:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acda7bf900 going to sleep for 11 seconds 00000100:00100000:1.0:1785394075.815481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394075.815746:0:14753:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14753:1872120831404672:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785394075.815792:0:14753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.815820:0:14753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93acd7c58800, rc 0) 00000100:00100000:0.0:1785394075.815887:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+8:14449:x1872120807294080:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 8421us (10825us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394075.815929:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1785394075.819606:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294208 00000100:00100000:2.0:1785394075.819622:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294208 00010000:00010000:2.0:1785394075.819679:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394075.819725:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1785394075.819736:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+8:2358:x1872120807294208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785394075.819753:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785394075.819781:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.819796:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.819824:0:14100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a11a4b4/0xcc9b96d8b362b047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb24 expref: 8 pid: 14751 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.819846:0:14100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394075.819867:0:14100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394075.819875:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 7 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.819887:0:14100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 7 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.819933:0:14100:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 7 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394075.819950:0:14100:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7ebaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14100:1872120831404800:192.168.203.12@tcp:105: 00000100:00100000:2.0:1785394075.820058:0:14100:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acd7e4ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1785394075.823675:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.823866:0:14100:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7ebaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14100:1872120831404800:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785394075.823891:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394075.823962:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2358:x1872120807294208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4227us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.823973:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1785394075.827122:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294336 00000100:00100000:1.0:1785394075.827152:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294336 00000100:00100000:1.0:1785394075.827230:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1785394075.827242:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2358:x1872120807294336:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785394075.827497:0:14752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785394075.827501:0:14752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1785394073 00002000:00010000:1.0:1785394075.827503:0:14752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1785394072 00002000:00010000:1.0:1785394075.827506:0:14752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785394074 -> 1785394073 00002000:00010000:1.0:1785394075.827508:0:14752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785394075.827561:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+8:2358:x1872120807294336:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 322us (3898us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1785394075.827606:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1785394075.847295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394075.847406:0:15224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294464 00000100:00100000:0.0:1785394075.847420:0:15224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294464 00000100:00100000:0.0:1785394075.847489:0:15224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1785394075.847501:0:15224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acfa128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+8:2359:x1872120807294464:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1785394075.847561:0:15224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.847619:0:15224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.847628:0:15224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394075.847632:0:15224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785394075.847637:0:15224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.847682:0:15224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.847696:0:15224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.847714:0:15224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15224:1872120831404928:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785394075.847818:0:15224:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acda7bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1785394075.851287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.851372:0:14102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294592 00000100:00100000:3.0:1785394075.851382:0:14102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294592 00010000:00010000:3.0:1785394075.851436:0:14102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 9 pid: 14753 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394075.851479:0:14102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1785394075.851490:0:14102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:2358:x1872120807294592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785394075.851507:0:14102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394075.851537:0:14102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 9 pid: 14753 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.851554:0:14102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 9 pid: 14753 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.851621:0:14102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785394075.851627:0:14102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785394075.851651:0:14102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.851663:0:14102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.851688:0:14102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394075.851744:0:14102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:2358:x1872120807294592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 255us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.851753:0:14102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:0.0:1785394075.853455:0:15224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b055 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb2b expref: 8 pid: 14753 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.853492:0:15224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15224:1872120831404928:192.168.203.12@tcp:104: 00010000:00010000:0.0:1785394075.853522:0:15224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853536:0:15224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853545:0:15224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853634:0:15224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853646:0:15224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853655:0:15224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853662:0:15224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394075.853667:0:15224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853677:0:15224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853704:0:15224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.853712:0:15224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d06492/0xcc9b96d8b362b05c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.853797:0:15224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acfa128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2359:x1872120807294464:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 6297us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394075.853806:0:15224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1785394075.869759:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394075.869845:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294848 00000100:00100000:0.0:1785394075.869857:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294848 00000100:00100000:0.0:1785394075.869919:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1785394075.869930:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:14449:x1872120807294848:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785394075.870035:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.870056:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.870166:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.870492:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.870505:0:14115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 15 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.870527:0:14115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.876350:0:14115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 15 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.876388:0:14115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 15 pid: 14115 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394075.876438:0:14115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14115:1872120831405056:192.168.203.12@tcp:104: 00000100:00100000:0.0:1785394075.876593:0:14115:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc6af89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785394075.883688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.885976:0:14100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807294976 00000100:00100000:3.0:1785394075.885992:0:14100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807294976 00010000:00010000:3.0:1785394075.886057:0:14100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 16 pid: 14115 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394075.886117:0:14100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1785394075.886129:0:14100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+16:2359:x1872120807294976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785394075.886147:0:14100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785394075.886156:0:14100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 16 pid: 14115 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.886171:0:14100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 16 pid: 14115 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.886217:0:14100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:3.0:1785394075.886224:0:14100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.886260:0:14100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.886271:0:14100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.886293:0:14100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785394075.886369:0:14100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+16:2359:x1872120807294976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 242us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394075.886378:0:14100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1785394075.887201:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b032 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddb16 expref: 15 pid: 14115 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394075.887223:0:14115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf76a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14115:1872120831405056:192.168.203.12@tcp:104: 00010000:00010000:2.0:1785394075.887249:0:14115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.887259:0:14115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.887266:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785394075.887515:0:14115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1785394075.887727:0:14115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1785394075.887771:0:14115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1785394075.887861:0:14115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14115:1872120831405184:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1785394075.887934:0:14115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785394075.887967:0:14115:0:(client.c:2702:ptlrpc_set_wait()) set ffff93acc1377e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785394075.888431:0:14120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405184 00000100:00100000:0.0:1785394075.888439:0:14120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405184 00000100:00100000:0.0:1785394075.888486:0:14120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785394075.888495:0:14120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14115:x1872120831405184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785394075.888607:0:14120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14115:x1872120831405184:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394075.888615:0:14120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785394075.889263:0:14115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14115:1872120831405184:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1785394075.889970:0:14115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1785394075.892233:0:14115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14115:1872120831405312:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1785394075.892312:0:14115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394075.892351:0:14115:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef780 going to sleep for 11 seconds 00000100:00100000:0.0:1785394075.892410:0:14120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405312 00000100:00100000:0.0:1785394075.892419:0:14120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405312 00000100:00100000:0.0:1785394075.892472:0:14120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785394075.892483:0:14120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14115:x1872120831405312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785394075.892767:0:14120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14115:x1872120831405312:12345-0@lo:1000:mdt00_000.0 Request processed in 285us (453us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1785394075.892776:0:14120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785394075.892995:0:14115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14115:1872120831405312:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1785394075.893053:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893162:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893174:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893181:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58800 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.893186:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893204:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893236:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:3.0:1785394075.893239:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785394075.893245:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893251:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58800/0xcc9b96d8b362b06a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893287:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893294:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893301:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893306:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2c00 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.893309:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893315:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893323:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394075.893325:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785394075.893333:0:14115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893345:0:14115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893363:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.893420:0:14115:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b3200/0xcc9b96d8b362afc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xe73eab26dd7ddafa expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394075.893433:0:14115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14115:1872120831405440:192.168.203.12@tcp:105: 00000100:00100000:3.0:1785394075.893501:0:14115:0:(client.c:2702:ptlrpc_set_wait()) set ffff93abc2eef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785394075.896303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394075.896440:0:14115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14115:1872120831405440:192.168.203.12@tcp:105: 00010000:00010000:3.0:1785394075.896472:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896484:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93abc31b2c00/0xcc9b96d8b362afc2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896523:0:14115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896539:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896552:0:14115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896563:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896586:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896609:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896615:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42200 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.896620:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896628:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896641:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394075.896645:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785394075.896648:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896654:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ace2d42200/0xcc9b96d8b362b071 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896664:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896669:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896675:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896681:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58400 already unused, calling callback (ffffffffc218d4f0) 00010000:00010000:3.0:1785394075.896684:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896698:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896707:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93acd96a4c00) 00010000:00010000:3.0:1785394075.896710:0:14115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785394075.896713:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394075.896719:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93acd7c58400/0xcc9b96d8b362b063 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394075.896981:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+18:14449:x1872120807294848:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 27051us (27236us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1785394075.896994:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000020:00080000:3.0:1785394075.897000:0:14115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1785394075.899700:0:14149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1785394075.899708:0:14149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785394075.899742:0:14149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1785394075.899749:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1785394075.902592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394075.907488:0:14119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295104 00000100:00100000:2.0:1785394075.907507:0:14119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295104 00000100:00100000:2.0:1785394075.907566:0:14119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295360 00000100:00100000:2.0:1785394075.908435:0:14119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295360 00000100:00100000:2.0:1785394075.908468:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1785394075.908479:0:14119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acc83fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14447:x1872120807295104:12345-192.168.203.12@tcp:49:dd.0 00000100:00100000:2.0:1785394075.908723:0:14119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acc83fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+19:14447:x1872120807295104:12345-192.168.203.12@tcp:49:dd.0 Request processed in 244us (12434us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394075.908732:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1785394075.908847:0:14119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1785394075.908855:0:14119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+18:14449:x1872120807295360:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785394075.915755:0:14119:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785394075.915883:0:14119:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1785394075.915972:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.915993:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.917667:0:14119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.917685:0:14119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.917693:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.917700:0:14119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394075.917776:0:14119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785394075.917924:0:14119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+20:14449:x1872120807295360:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 9063us (15356us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1785394075.917936:0:14119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000020:00080000:2.0:1785394075.917943:0:14119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785394075.925454:0:15609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785394075.925473:0:15609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.925486:0:15609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394075.925490:0:15609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.925502:0:15609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.925523:0:15609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93acc89f9a00) 00010000:00010000:0.0:1785394075.925526:0:15609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785394075.925532:0:15609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.925539:0:15609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ad007d1c00/0xcc9b96d8b362b078 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394075.925559:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394075.925561:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394075.925563:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785394076.116490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.116693:0:14756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295488 00000100:00100000:1.0:1785394076.116707:0:14756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295488 00000100:00100000:1.0:1785394076.116785:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1785394076.116796:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+7:2360:x1872120807295488:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:1.0:1785394076.116855:0:14756:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a6af399, atime: 0x6a6af398, ctime: 0x6a6af399, blocks: 0x1 00010000:00010000:1.0:1785394076.116866:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.116886:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=608s v=(0 0) 00010000:00010000:1.0:1785394076.116892:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394076.116899:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.116937:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394076.122895:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394076.126233:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1785394076.126253:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1785394076.128525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.128682:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1785394076.128701:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295616 00000100:00100000:1.0:1785394076.128711:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295616 00000100:00100000:1.0:1785394076.128773:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1785394076.128779:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295744 00000100:00100000:1.0:1785394076.128782:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295744 00000100:00100000:0.0:1785394076.133245:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785394076.133266:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+10:2360:x1872120807295616:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:0.0:1785394076.133318:0:16254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.134228:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394076.134233:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394076.134242:0:16254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.134261:0:16254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785394076.140108:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.142891:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1785394076.142908:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1785394076.144232:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807295872 00000100:00100000:1.0:1785394076.144245:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807295872 00000100:00100000:1.0:1785394076.144855:0:16255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1785394076.144867:0:16255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+12:2360:x1872120807295744:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:1.0:1785394076.144909:0:16255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.144928:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394076.144932:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785394076.144939:0:16255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.144957:0:16255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394076.146061:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394076.146655:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1785394076.146665:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1785394076.147552:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296000 00000100:00100000:3.0:1785394076.147563:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296000 00000100:00100000:2.0:1785394076.148412:0:16256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1785394076.148425:0:16256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+14:2360:x1872120807295872:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:2.0:1785394076.148461:0:16256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.148479:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.148484:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.148491:0:16256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.148517:0:16256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394076.158931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.158971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.158996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394076.159016:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1785394076.159026:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:1.0:1785394076.159147:0:14757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296128 00000100:00100000:1.0:1785394076.159159:0:14757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296128 00000100:00100000:3.0:1785394076.161848:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1785394076.161866:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296256 00000100:00100000:3.0:1785394076.161874:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296256 00000100:00100000:3.0:1785394076.161931:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1785394076.161937:0:14758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296384 00000100:00100000:3.0:1785394076.161940:0:14758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296384 00000100:00100000:3.0:1785394076.163319:0:16257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1785394076.163339:0:16257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+18:2360:x1872120807296000:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:3.0:1785394076.163388:0:16257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394076.163404:0:16257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394076.163409:0:16257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785394076.163416:0:16257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785394076.163430:0:16257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785394076.327584:0:14756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1785394076.327596:0:14756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1785394073 -> 1785394075 00002000:00010000:2.0:1785394076.327599:0:14756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1785394073 -> 1785394075 00002000:00010000:2.0:1785394076.327601:0:14756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1785394076.327619:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327635:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327645:0:14756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327653:0:14756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394076.327658:0:14756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327667:0:14756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327692:0:14756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327724:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c05439/0xcc9b96d8b362b07f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394076.327839:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+28:2360:x1872120807295488:12345-192.168.203.12@tcp:4:dd.0 Request processed in 211039us (211356us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1785394076.327850:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1785394076.327895:0:14756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1785394076.327908:0:14756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+27:2360:x1872120807296256:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:2.0:1785394076.327948:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327963:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.327968:0:14756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.327976:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.327989:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785394076.332421:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1785394076.332451:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1785394076.332458:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1785394076.431688:0:16257:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1785394076.431702:0:16257:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 10247 00010000:00010000:2.0:1785394076.431720:0:16257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431734:0:16257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431761:0:16257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431769:0:16257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ace2d42a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394076.431774:0:16257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431783:0:16257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431807:0:16257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.431815:0:16257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6638458/0xcc9b96d8b362b09b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394076.431925:0:16257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+25:2360:x1872120807296000:12345-192.168.203.12@tcp:4:dd.0 Request processed in 268586us (285860us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1785394076.431936:0:16257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1785394076.431977:0:16257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1785394076.431990:0:16257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:2360:x1872120807296384:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:2.0:1785394076.432028:0:16257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.432042:0:16257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.432052:0:16257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785394076.432059:0:16257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.432078:0:16257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432449:0:16254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432459:0:16254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432466:0:16254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432472:0:16254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c59000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394076.432476:0:16254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432483:0:16254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432494:0:16254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432521:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b64f74d/0xcc9b96d8b362b086 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394076.432559:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+24:2360:x1872120807295616:12345-192.168.203.12@tcp:4:dd.0 Request processed in 299299us (309678us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1785394076.432567:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1785394076.432618:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1785394076.432626:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:2360:x1872120807296128:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:0.0:1785394076.432642:0:16254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432651:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394076.432654:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785394076.432658:0:16254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.432667:0:16254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433249:0:16256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433260:0:16256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433269:0:16256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433276:0:16256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394076.433280:0:16256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433288:0:16256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433300:0:16256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.433307:0:16256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d036b6/0xcc9b96d8b362b094 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394076.433510:0:16256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+23:2360:x1872120807295872:12345-192.168.203.12@tcp:4:dd.0 Request processed in 285087us (293417us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1785394076.433518:0:16256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00010000:00010000:1.0:1785394076.437443:0:16255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437462:0:16255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437472:0:16255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437479:0:16255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93abc31b2c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785394076.437484:0:16255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437492:0:16255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437514:0:16255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785394076.437522:0:16255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed27bc5b/0xcc9b96d8b362b08d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785394076.437635:0:16255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+21:2360:x1872120807295744:12345-192.168.203.12@tcp:4:dd.0 Request processed in 292766us (309114us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1785394076.437662:0:16255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000001:00080000:0.0:1785394076.442689:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1785394076.524175:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1785394076.532317:0:14756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1785394076.532329:0:14756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:2.0:1785394076.532397:0:14756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532414:0:14756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532424:0:14756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532432:0:14756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d0e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785394076.532437:0:14756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532446:0:14756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532471:0:14756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785394076.532479:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000068a494/0xcc9b96d8b362b0a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785394076.532645:0:14756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+11:2360:x1872120807296256:12345-192.168.203.12@tcp:4:dd.0 Request processed in 204734us (373666us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1785394076.532656:0:14756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00010000:00010000:0.0:1785394076.541398:0:16257:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541423:0:16257:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541447:0:16257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541456:0:16257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ad007d1600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394076.541462:0:16257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541472:0:16257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541496:0:16257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.541505:0:16257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b10b6c1/0xcc9b96d8b362b0a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394076.541643:0:16257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+9:2360:x1872120807296384:12345-192.168.203.12@tcp:4:dd.0 Request processed in 109651us (382639us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1785394076.541654:0:16257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00010000:00010000:2.0:1785394076.640045:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785394076.647559:0:6656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1785394076.647722:0:16254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647741:0:16254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647774:0:16254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647782:0:16254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93acd7c58800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785394076.647788:0:16254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647799:0:16254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647822:0:16254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785394076.647831:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc313339/0xcc9b96d8b362b0b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785394076.647950:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2360:x1872120807296128:12345-192.168.203.12@tcp:4:dd.0 Request processed in 215317us (489025us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1785394076.647961:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1785394076.704555:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831405568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785394076.704672:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785394076.704858:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405568 00000100:00100000:1.0:1785394076.704869:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405568 00000100:00100000:1.0:1785394076.704938:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785394076.704949:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831405568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785394076.704976:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1785394076.705152:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831405568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394076.705161:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785394076.705346:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1785394076.705353:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ad003c8700, transno 8589934595 00000004:00080000:3.0:1785394076.705372:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1785394076.705412:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831405568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785394077.665102:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785394077.996899:0:14149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785394077.996910:0:14149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785394077.997471:0:14149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1785394077.997484:0:14149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1785394078.263530:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394078.263551:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831405696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785394078.263626:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.263682:0:14754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405696 00000100:00100000:3.0:1785394078.263689:0:14754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405696 00000100:00100000:3.0:1785394078.263737:0:14754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785394078.263755:0:14754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831405696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785394078.263787:0:14754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785394078.263839:0:14754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf7d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1872120831405696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.263846:0:14754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1785394078.263864:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785394078.263893:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1872120831405696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785394078.271908:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831405952:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.271977:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.272015:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785394078.272022:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831405824:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272050:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.272076:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831406336:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272102:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.272133:0:14752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405952 00000100:00100000:3.0:1785394078.272139:0:14752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405952 00000100:00100000:3.0:1785394078.272201:0:14752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785394078.272212:0:14752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831405952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272261:0:14752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1872120831405952:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.272268:0:14752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1785394078.272289:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785394078.272300:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831406080:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.272358:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785394078.272364:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93acf75a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831406208:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272394:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785394078.272433:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831406336 00000100:00100000:3.0:1785394078.272437:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831406336 00000100:00100000:3.0:1785394078.272464:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831406080 00000100:00100000:3.0:1785394078.272467:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831406080 00000100:00100000:3.0:1785394078.272479:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831406208 00000100:00100000:3.0:1785394078.272482:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831406208 00000100:00100000:3.0:1785394078.272494:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785394078.272500:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831406336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272531:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1872120831406336:12345-0@lo:400:kworker.0 Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.272538:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785394078.272551:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785394078.272557:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831406080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272611:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1872120831406080:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.272616:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785394078.272629:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785394078.272635:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831406208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272661:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1872120831406208:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.272667:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1785394078.272681:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785394078.272706:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1872120831406336:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272717:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1872120831405952:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272745:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1872120831406208:0@lo:400:kworker.0 00000100:00100000:3.0:1785394078.272763:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf75a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1872120831406080:0@lo:400:kworker.0 00000100:00100000:0.0:1785394078.273148:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120831405824 00000100:00100000:0.0:1785394078.273153:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120831405824 00000100:00100000:0.0:1785394078.273198:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1785394078.273206:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785394078.273247:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:daecb8d0-f73c-4aec-8915-f89616659996+19:3318:x1872120831405824:12345-0@lo:400:kworker.0 Request processed in 42us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785394078.273264:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1785394078.274150:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93acf7d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:daecb8d0-f73c-4aec-8915-f89616659996:3318:1872120831405824:0@lo:400:kworker.0 00010000:00010000:0.0:1785394078.688308:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785394078.785859:0:16296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1785394078.928187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394078.928254:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1785394078.928761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394078.940853:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296896 00000100:00100000:1.0:1785394078.940867:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296896 00000100:00100000:1.0:1785394078.940949:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807297152 00000100:00100000:1.0:1785394078.940952:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807297152 00000100:00100000:1.0:1785394078.940979:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1785394078.940987:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2357:x1872120807296896:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1785394078.941015:0:14753:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362adae 00000100:00080000:1.0:1785394078.941027:0:14753:0:(import.c:65:import_set_state_nolock()) ffff93abc125f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785394078.941592:0:14753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1785394078.941909:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+2:2357:x1872120807296896:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 921us (13745us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394078.942153:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1785394078.942189:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1785394078.942200:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2357:x1872120807297152:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1785394078.942216:0:14753:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362addf 00000100:00080000:1.0:1785394078.942235:0:14753:0:(import.c:65:import_set_state_nolock()) ffff93acd7580800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785394078.942256:0:14753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1785394078.942426:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+2:2357:x1872120807297152:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 228us (14171us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394078.942433:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00080000:1.0:1785394078.942454:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785394078.942458:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785394078.942516:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785394078.942600:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785394078.942613:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807297280 00000100:00100000:1.0:1785394078.942618:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807297280 00000100:00100000:1.0:1785394078.942656:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1785394078.942674:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf76a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+5:2357:x1872120807297280:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:1.0:1785394078.942690:0:14753:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcc9b96d8b362ade6 00000100:00080000:1.0:1785394078.942694:0:14753:0:(import.c:65:import_set_state_nolock()) ffff93acd7582800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785394078.942723:0:14753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1785394078.942816:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf76a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01dc2679-0e90-4bb5-beb6-6fa722754450+2:2357:x1872120807297280:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 153us (14054us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394078.942822:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:1.0:1785394078.942838:0:15609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785394078.942844:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785394078.942875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1785394078.947470:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296512 00000100:00100000:1.0:1785394078.947484:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296512 00000100:00100000:1.0:1785394078.947549:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1785394078.947559:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807296512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394078.957335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1785394078.957492:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296768 00000100:00100000:2.0:1785394078.957504:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296768 00000100:00100000:2.0:1785394078.957615:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1785394078.957678:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807296768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1785394078.957766:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+5:2359:x1872120807296768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1785394078.957774:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1785394078.957874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394078.958508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1785394078.958546:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807296640 00000100:00100000:3.0:1785394078.958551:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807296640 00000100:00100000:3.0:1785394078.958603:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872120807297024 00000100:00100000:3.0:1785394078.958606:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872120807297024 00000100:00100000:3.0:1785394078.958622:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1785394078.959188:0:14115:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785394078.959199:0:14115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1785394078.959699:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+20:2359:x1872120807296640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394078.959758:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54ced0b8-95bd-40d4-bb9f-7a6e75b3691c+20:2359:x1872120807296640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1129us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.959765:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1785394078.959780:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1785394078.959786:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93acf75a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2359:x1872120807297024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1785394078.959810:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acf75a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01dc2679-0e90-4bb5-beb6-6fa722754450+6:2359:x1872120807297024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1785394078.959816:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00080000:3.0:1785394078.961902:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785394078.961912:0:14111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785394078.974269:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93acd0472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48ad2632-9b6b-4944-a25d-e13ca0e061fc+13:2359:x1872120807296512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26700us (31382us total) trans 0 rc 0/0 00000100:00100000:1.0:1785394078.974296:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00010000:00010000:1.0:1785394079.711785:0:14103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785394080.738661:0:14104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785394080.900516:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:2.0:1785394080.900531:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1785394080.900540:0:5853:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93acc1377900 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1785394080.900545:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf8a4f400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93acc13706c0 00000020:00080000:2.0:1785394080.900548:0:5853:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93acf8a4f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93abc2dc5000 00000020:00080000:1.0:1785394080.901783:0:14153:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1785394080.901956:0:14153:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 31439 lines, 31439 kept, 0 dropped, 0 bad.